00000001:02000400:2.0F:1787392916.460423:0:2978:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1787392935.344384:0:3201:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1787392936.968949:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 699 MB/s 00000001:01000000:3.0F:1787392937.219355:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 607 MB/s 00000001:01000000:2.0:1787392937.471313:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2515 MB/s 00000020:02000000:1.0:1787392938.098958:0:3293:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_109_gc67c2f0 00000400:02000000:0.0:1787392939.033515:0:3308:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.203.121@tcp [8/256/0/180] 00008000:02000000:1.0:1787392941.951406:0:3458:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787392991.434382:0:5261:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787392999.800421:0:5801:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787392999.800427:0:5801:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787392999.800562:0:5801:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000066da7754 00000080:02000400:2.0:1787392999.800573:0:5801:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787392999.806796:0:5801:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787392999.806811:0:5801:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787392999.807195:0:5801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000090880e0f) 00000020:00000080:3.0:1787392999.807213:0:5801:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787392999.827509:0:5801:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787392999.828177:0:5801:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787392999.856725:0:5801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787392999.856759:0:5801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787392999.856776:0:5801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787392999.856825:0:5801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787392999.856953:0:5801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787392999.857535:0:5801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787392999.857542:0:5801:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787392999.857552:0:5801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a927d9c62f1039 00000020:01000004:2.0:1787392999.857559:0:5801:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787392999.857563:0:5801:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787392999.857567:0:5801:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000066da7754 from MGS 00000020:01000004:2.0:1787392999.857572:0:5801:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787392999.857596:0:5801:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000001d95c28e) 00000020:00000080:2.0:1787392999.857608:0:5801:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787392999.857696:0:5801:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000066da7754 from MGS, refs=2 00080000:01000000:2.0:1787392999.857701:0:5801:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787392999.857706:0:5801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a927d9c62f1047 00000100:00100000:2.0:1787392999.857794:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787392999.858180:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787392999.858187:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787392999.862242:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787392999.862254:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787392999.863347:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787392999.863626:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787392999.863630:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787392999.864529:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787392999.864536:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787392999.864752:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787392999.864758:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787392999.867015:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787392999.867021:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787392999.867023:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787392999.867779:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787392999.867783:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787392999.868183:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787392999.868768:0:5801:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787392999.878228:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1787393000.118376:0:5801:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3083 MB/s 00000001:01000000:0.0:1787393000.369036:0:5801:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3410 MB/s 00000001:01000000:2.0:1787393000.619514:0:5801:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 495 MB/s 00000001:01000000:0.0:1787393000.869698:0:5801:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 771 MB/s 00080000:10000000:0.0:1787393000.878339:0:5801:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1787393000.901470:0:5801:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787393000.901500:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787393000.901503:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787393000.916952:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787393000.917060:0:5801:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787393000.917129:0:5801:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787393000.917452:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787393000.917480:0:5801:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787393000.917785:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787393000.917964:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787393000.917971:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787393000.919642:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787393000.919653:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787393000.920825:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787393000.920833:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787393000.923010:0:5801:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787393000.923035:0:5801:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.121@tcp' 00000020:01000004:0.0:1787393000.923037:0:5801:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787393000.923085:0:5801:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.121@tcp (typ=mgc) 00000020:00000080:0.0:1787393000.923108:0:5801:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.121@tcp (000000003d365316) 00000020:00000080:0.0:1787393000.923124:0:5801:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787393000.923232:0:5801:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e73ed076@MGC192.168.203.121@tcp: add connection 192.168.203.121@tcp at head 00010000:00010000:0.0:1787393000.923394:0:5801:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.121@tcp-0 is initialized 00000040:01000000:0.0:1787393000.923401:0:5801:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787393000.925513:0:5816:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787393000.926570:0:5818:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787393000.926626:0:5801:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.121@tcp (uuid 28e76f01-627f-442b-bc98-cefaf6a7617a) 00000020:00000080:2.0:1787393000.926648:0:5801:0:(genops.c:1406:class_connect()) connect: client 28e76f01-627f-442b-bc98-cefaf6a7617a, cookie 0x19a927d9c62f1055 00000100:00080000:2.0:1787393000.926659:0:5801:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787393000.926664:0:5801:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import 00000000e73ed076 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:2.0:1787393000.926706:0:5801:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000257a281f x1874217338404992/t0(0) o250->MGC192.168.203.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787393000.926796:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000257a281f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:28e76f01-627f-442b-bc98-cefaf6a7617a:3323:1874217338404992:0@lo:250: 00000100:00100000:2.0:1787393000.926886:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393000.926962:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338404992 00000100:00100000:2.0:1787393000.926969:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338404992 00000100:00100000:2.0:1787393000.926997:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787393000.927003:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f920da6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3323:x1874217338404992:12345-0@lo:250: 00010000:00080000:2.0:1787393000.927022:0:5813:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 28e76f01-627f-442b-bc98-cefaf6a7617a@0@lo t0 exp 0000000000000000 cur 150 last 0 00000020:00000080:2.0:1787393000.927044:0:5813:0:(genops.c:1406:class_connect()) connect: client 28e76f01-627f-442b-bc98-cefaf6a7617a, cookie 0x19a927d9c62f105c 00000100:00080000:2.0:1787393000.927525:0:5813:0:(import.c:65:import_set_state_nolock()) 000000009f774ee5 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787393000.927588:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f920da6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+5:3323:x1874217338404992:12345-0@lo:250: Request processed in 583us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393000.927596:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787393000.927626:0:5801:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 28e76f01-627f-442b-bc98-cefaf6a7617a->MGS 00000020:01000004:2.0:1787393000.927641:0:5801:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787393000.927646:0:5801:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787393000.927658:0:5801:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000042f4d9ee) 00000020:00000080:2.0:1787393000.927669:0:5801:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787393000.928043:0:3323:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.121@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787393000.928052:0:3323:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.121@tcp: connect to target with instance 0 00000100:00080000:3.0:1787393000.928059:0:3323:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.121@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787393000.928062:0:3323:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787393000.928065:0:3323:0:(import.c:65:import_set_state_nolock()) 00000000e73ed076 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787393000.928067:0:3323:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787393000.928076:0:3323:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787393000.928080:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000257a281f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:28e76f01-627f-442b-bc98-cefaf6a7617a:3323:1874217338404992:0@lo:250: 00010000:00010000:0.0:1787393000.936109:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393000.954678:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787393000.954912:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787393000.955436:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787393000.957329:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787393000.957339:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787393000.957761:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787393000.957768:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787393000.958718:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787393000.959024:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787393000.959032:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787393000.959627:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787393000.959641:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787393001.002384:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787393001.003274:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787393001.003281:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787393001.005022:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787393001.005038:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787393001.006358:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787393001.006608:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787393001.006614:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787393001.008824:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787393001.008859:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787393001.009642:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787393001.009780:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787393001.009785:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787393001.010388:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787393001.010395:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787393001.018459:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787393001.018631:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787393001.018637:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787393001.019505:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787393001.019514:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787393001.063667:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787393001.063943:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787393001.063958:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787393001.066465:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787393001.066480:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787393001.068162:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787393001.068176:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787393001.079355:0:5801:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787393001.079388:0:5801:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787393001.079393:0:5801:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.121@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787393001.079529:0:5801:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787393001.079569:0:5801:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.121@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787393001.079573:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787393001.079575:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787393001.079580:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787393001.079581:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787393001.079582:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787393001.079583:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787393001.079584:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787393001.079585:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787393001.079587:0:5801:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787393001.079588:0:5801:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787393001.079589:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787393001.079590:0:5801:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787393001.079593:0:5801:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787393001.079595:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787393001.079595:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787393001.079596:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787393001.079597:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787393001.079598:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787393001.079599:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787393001.079600:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787393001.079601:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787393001.079602:0:5801:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787393001.079602:0:5801:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787393001.079603:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787393001.079604:0:5801:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787393001.079642:0:5801:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787393001.079659:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098963d4e pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338405120:0@lo:253: 00000100:00100000:1.0:1787393001.079741:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393001.079795:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c532093d going to sleep for 11 seconds 00000100:00100000:3.0:1787393001.080066:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338405120 00000100:00100000:3.0:1787393001.080073:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338405120 00000100:00100000:3.0:1787393001.080119:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787393001.080126:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078f03f6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+5:5801:x1874217338405120:12345-0@lo:253: 20000000:01000000:3.0:1787393001.080168:0:5815:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787393001.080171:0:5815:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787393001.080532:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787393001.080589:0:5815:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787393001.080883:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787393001.081819:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787393001.082179:0:5815:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787393001.082183:0:5815:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787393001.082189:0:5815:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787393001.082192:0:5815:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787393001.082208:0:5815:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787393001.083892:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787393001.084328:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787393001.084343:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787393001.084394:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787393001.084456:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787393001.084495:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787393001.084601:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787393001.084610:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787393001.084654:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787393001.084663:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787393001.084694:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787393001.084701:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787393001.084729:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787393001.084803:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787393001.084863:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787393001.084871:0:5815:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787393001.084887:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787393001.085380:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787393001.085392:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787393001.085428:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787393001.085526:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787393001.085574:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787393001.085586:0:5815:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787393001.085657:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787393001.085666:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787393001.085707:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787393001.085742:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787393001.085787:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787393001.085798:0:5815:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787393001.087382:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787393001.087403:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787393001.090127:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787393001.090259:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787393001.090504:0:5815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787393001.090553:0:5815:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787393001.090561:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787393001.093435:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787393001.098211:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787393001.098255:0:5815:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.121@tcp for mdt 20000000:01000000:0.0:1787393001.098266:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.121@tcp (null) (null) (null) 00000040:00080000:0.0:1787393001.098308:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787393001.098316:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787393001.098347:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787393001.098356:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.121@tcp (null) (null) 00000040:00080000:0.0:1787393001.098402:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787393001.098412:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787393001.099031:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787393001.099087:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787393001.099188:0:5815:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787393001.099192:0:5815:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787393001.099197:0:5815:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787393001.099203:0:5815:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787393001.103184:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1787393001.103387:0:5815:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787393001.118484:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787393001.118537:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1787393001.118607:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1787393001.118626:0:5815:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787393001.118629:0:5815:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787393001.118633:0:5815:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787393001.118646:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787393001.118648:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787393001.118676:0:5815:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787393001.118678:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787393001.124011:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787393001.124346:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787393001.124399:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787393001.124426:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1787393001.124446:0:5815:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787393001.124449:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787393001.124916:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1787393001.125177:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1787393001.125208:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1787393001.125302:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:2.0:1787393001.125316:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787393001.125319:0:5815:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1787393001.125325:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787393001.125345:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001c3ac84b/0x19a927d9c62f106a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393001.125428:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001c3ac84b/0x19a927d9c62f106a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393001.125505:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001c3ac84b/0x19a927d9c62f106a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393001.125511:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001c3ac84b/0x19a927d9c62f106a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393001.125516:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001c3ac84b/0x19a927d9c62f106a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393001.125522:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001c3ac84b/0x19a927d9c62f106a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393001.125527:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001c3ac84b already unused, calling callback (00000000549419c9) 00010000:00010000:2.0:1787393001.125531:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001c3ac84b/0x19a927d9c62f106a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393001.125538:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001c3ac84b/0x19a927d9c62f106a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393001.125549:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001c3ac84b/0x19a927d9c62f106a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393001.125556:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001c3ac84b/0x19a927d9c62f106a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393001.125561:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001c3ac84b/0x19a927d9c62f106a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787393001.125576:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787393001.463873:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078f03f6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+5:5801:x1874217338405120:12345-0@lo:253: Request processed in 383711us (384097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393001.463893:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787393001.464018:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098963d4e pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338405120:0@lo:253: 10000000:01000000:2.0:1787393001.464051:0:5801:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787393001.464055:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787393001.464057:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787393001.464058:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787393001.464059:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787393001.464060:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787393001.464062:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787393001.464063:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787393001.464065:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787393001.464066:0:5801:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787393001.464067:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787393001.464069:0:5801:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787393001.464086:0:5801:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000066da7754 from lustre-MDT0000 10000000:01000000:2.0:1787393001.464107:0:5801:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787393001.464110:0:5801:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787393001.464114:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9de8180e99c0 10000000:01000000:2.0:1787393001.464118:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787393001.464124:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9de8180e99c0 from 1 10000000:01000000:2.0:1787393001.464127:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787393001.464158:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 000000001c3ac84b/0x19a927d9c62f1071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393001.464168:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 000000001c3ac84b/0x19a927d9c62f1071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393001.464175:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 000000001c3ac84b/0x19a927d9c62f1071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393001.464191:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009020720b pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338405248:0@lo:101: 00000100:00100000:2.0:1787393001.464233:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393001.464286:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eb96d136 going to sleep for 11 seconds 00000100:00100000:3.0:1787393001.464345:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338405248 00000100:00100000:3.0:1787393001.464361:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338405248 00000100:00100000:3.0:1787393001.464397:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787393001.464405:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c2b1c8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+5:5801:x1874217338405248:12345-0@lo:101: 00010000:00010000:3.0:1787393001.464416:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393001.464429:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003934a5f6/0x19a927d9c62f1078 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f1071 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393001.464450:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003934a5f6/0x19a927d9c62f1078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f1071 expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393001.464459:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003934a5f6/0x19a927d9c62f1078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1071 expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393001.464467:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003934a5f6, rc 0) 00000100:00100000:3.0:1787393001.464501:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c2b1c8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+6:5801:x1874217338405248:12345-0@lo:101: Request processed in 98us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393001.464508:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787393001.464665:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009020720b pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338405248:0@lo:101: 00010000:00010000:2.0:1787393001.464684:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 000000001c3ac84b/0x19a927d9c62f1071 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1078 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393001.464692:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 000000001c3ac84b/0x19a927d9c62f1071 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f1078 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393001.464734:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009020720b pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338405376:0@lo:501: 00000100:00100000:2.0:1787393001.464759:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393001.464781:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eb96d136 going to sleep for 11 seconds 00000100:00100000:1.0:1787393001.464833:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338405376 00000100:00100000:1.0:1787393001.464870:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338405376 00000100:00100000:1.0:1787393001.464909:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787393001.464915:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3d382c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+6:5801:x1874217338405376:12345-0@lo:501: 00000100:00100000:1.0:1787393001.465102:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3d382c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+6:5801:x1874217338405376:12345-0@lo:501: Request processed in 187us (342us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787393001.465111:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787393001.466648:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009020720b pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338405376:0@lo:501: 10000000:01000000:2.0:1787393001.466683:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787393001.466705:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 000000001c3ac84b/0x19a927d9c62f1071 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1078 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393001.466714:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 000000001c3ac84b/0x19a927d9c62f1071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1078 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393001.466722:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9de804ca6000 10000000:01000000:2.0:1787393001.466729:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787393001.466734:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9de804ca6000 10000000:01000000:2.0:1787393001.466737:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787393001.466739:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9de804ca6000 from 1 10000000:01000000:2.0:1787393001.466742:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787393001.466768:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 000000009b1545d7/0x19a927d9c62f107f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393001.466775:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 000000009b1545d7/0x19a927d9c62f107f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393001.466799:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 000000009b1545d7/0x19a927d9c62f107f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393001.466814:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009020720b pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338405504:0@lo:101: 00000100:00100000:2.0:1787393001.466897:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393001.466936:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eb96d136 going to sleep for 11 seconds 00000100:00100000:1.0:1787393001.467093:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338405504 00000100:00100000:1.0:1787393001.467099:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338405504 00000100:00100000:1.0:1787393001.467141:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787393001.467149:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000259816cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+6:5801:x1874217338405504:12345-0@lo:101: 00010000:00010000:1.0:1787393001.467161:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393001.467173:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000069d7705d/0x19a927d9c62f1086 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f107f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393001.467191:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069d7705d/0x19a927d9c62f1086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f107f expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393001.467200:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000069d7705d/0x19a927d9c62f1086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f107f expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393001.467209:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000069d7705d, rc 0) 00000100:00100000:1.0:1787393001.467263:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000259816cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+7:5801:x1874217338405504:12345-0@lo:101: Request processed in 114us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393001.467270:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787393001.467356:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009020720b pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338405504:0@lo:101: 00010000:00010000:3.0:1787393001.467368:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 000000009b1545d7/0x19a927d9c62f107f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1086 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393001.467375:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 000000009b1545d7/0x19a927d9c62f107f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f1086 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393001.467397:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787393001.467412:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 000000009b1545d7/0x19a927d9c62f107f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1086 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393001.467418:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 000000009b1545d7/0x19a927d9c62f107f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1086 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393001.467423:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787393001.467426:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787393001.467431:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9de804ca6000 10000000:01000000:3.0:1787393001.467433:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787393001.467436:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787393001.467438:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787393001.467468:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 000000008926808b/0x19a927d9c62f108d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393001.467475:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 000000008926808b/0x19a927d9c62f108d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393001.467481:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 000000008926808b/0x19a927d9c62f108d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393001.467492:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004801b5a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338405632:0@lo:101: 00000100:00100000:3.0:1787393001.467523:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393001.467545:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b016a2c1 going to sleep for 11 seconds 00000100:00100000:1.0:1787393001.467683:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338405632 00000100:00100000:1.0:1787393001.467688:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338405632 00000100:00100000:1.0:1787393001.467719:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787393001.467725:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002cdfa83b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+7:5801:x1874217338405632:12345-0@lo:101: 00010000:00010000:1.0:1787393001.467732:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393001.467745:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004188073b/0x19a927d9c62f1094 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f108d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393001.467758:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004188073b/0x19a927d9c62f1094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f108d expref: 8 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393001.467765:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004188073b/0x19a927d9c62f1094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f108d expref: 8 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393001.467771:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004188073b, rc 0) 00000100:00100000:1.0:1787393001.467804:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002cdfa83b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+8:5801:x1874217338405632:12345-0@lo:101: Request processed in 80us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393001.467810:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787393001.467911:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004801b5a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338405632:0@lo:101: 00010000:00010000:3.0:1787393001.467921:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 000000008926808b/0x19a927d9c62f108d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1094 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393001.467964:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 000000008926808b/0x19a927d9c62f108d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f1094 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393001.468005:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004801b5a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338405760:0@lo:501: 00000100:00100000:3.0:1787393001.468030:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393001.468060:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b016a2c1 going to sleep for 11 seconds 00000100:00100000:1.0:1787393001.468292:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338405760 00000100:00100000:1.0:1787393001.468297:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338405760 00000100:00100000:1.0:1787393001.468326:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787393001.468332:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ca87eb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+8:5801:x1874217338405760:12345-0@lo:501: 00000100:00100000:1.0:1787393001.468561:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ca87eb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+9:5801:x1874217338405760:12345-0@lo:501: Request processed in 229us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393001.468568:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787393001.469584:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004801b5a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338405760:0@lo:501: 00000100:00100000:3.0:1787393001.469622:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004801b5a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338405888:0@lo:503: 00000100:00100000:3.0:1787393001.469674:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393001.469712:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b016a2c1 going to sleep for 11 seconds 00000100:00100000:2.0:1787393001.469774:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338405888 00000100:00100000:2.0:1787393001.469779:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338405888 00000100:00100000:2.0:1787393001.469815:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787393001.469822:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017877ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+9:5801:x1874217338405888:12345-0@lo:503: 00000100:00100000:2.0:1787393001.470010:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017877ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+9:5801:x1874217338405888:12345-0@lo:503: Request processed in 188us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393001.470017:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787393001.470256:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004801b5a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338405888:0@lo:503: 00000100:00100000:3.0:1787393001.472991:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004801b5a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:5843:1874217338406016:0@lo:502: 00000100:00100000:3.0:1787393001.473062:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393001.473101:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set 000000004c844071 going to sleep for 11 seconds 00000100:00100000:2.0:1787393001.474777:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338406016 00000100:00100000:2.0:1787393001.474790:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338406016 00000100:00100000:2.0:1787393001.474863:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787393001.474872:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbf6c594 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+9:5843:x1874217338406016:12345-0@lo:502: 00000100:00100000:2.0:1787393001.475122:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbf6c594 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+9:5843:x1874217338406016:12345-0@lo:502: Request processed in 251us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393001.475129:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787393001.475258:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004801b5a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:5843:1874217338406016:0@lo:502: 00000020:01000000:3.0:1787393001.475291:0:5843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787393001.475302:0:5843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393001.475304:0:5843:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787393001.475309:0:5843:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787393001.475312:0:5843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787393001.475325:0:5843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000004f923ef0) 00000020:00000080:3.0:1787393001.475341:0:5843:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787393001.475357:0:5843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787393001.475440:0:5843:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787393001.475447:0:5843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a927d9c62f10a2 00000020:00000080:3.0:1787393001.475672:0:5843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787393001.475684:0:5843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787393001.475687:0:5843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393001.475688:0:5843:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787393001.475690:0:5843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787393001.475693:0:5843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393001.475695:0:5843:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787393001.475698:0:5843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787393001.475705:0:5843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000e8cf1403) 00000020:00000080:3.0:1787393001.475715:0:5843:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787393001.475718:0:5843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787393001.475720:0:5843:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787393001.475723:0:5843:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787393001.475727:0:5843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787393001.475780:0:5843:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000066da7754 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787393001.475793:0:5843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000848fd682) 00000020:00000080:3.0:1787393001.475800:0:5843:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787393001.475878:0:5843:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787393001.475885:0:5843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a927d9c62f10b7 00000020:00000080:3.0:1787393001.475979:0:5843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787393001.475985:0:5843:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787393001.475989:0:5843:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x19a927d9c62f10be 00080000:01000000:3.0:1787393001.475994:0:5843:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787393001.475997:0:5843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a927d9c62f10c5 00080000:10000000:3.0:1787393001.476364:0:5843:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787393001.476583:0:5843:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787393001.483557:0:5843:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787393001.610472:0:5843:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787393001.610877:0:5843:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787393001.616556:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787393001.616832:0:5843:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787393001.702316:0:5843:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000076c8fd64) 00000020:00000080:2.0:1787393001.702348:0:5843:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787393001.702412:0:5843:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787393001.702419:0:5843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a927d9c62f10d3 00000020:00000080:0.0:1787393001.704506:0:5843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787393001.705812:0:5843:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787393001.749802:0:5843:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787393001.799873:0:5843:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787393001.831686:0:5843:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787393001.893624:0:5843:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787393001.940865:0:5843:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:0.0:1787393001.960562:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787393001.994558:0:5843:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x19a927d9c62f10da 00000020:00000080:0.0:1787393001.998781:0:5843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787393001.998795:0:5843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787393001.998802:0:5843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393001.998804:0:5843:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787393001.998807:0:5843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787393001.998822:0:5843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393001.998824:0:5843:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787393001.998829:0:5843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787393001.998912:0:5843:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787393001.998929:0:5843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787393001.998932:0:5843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393001.998933:0:5843:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787393001.998935:0:5843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787393001.998937:0:5843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393001.998938:0:5843:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787393001.998941:0:5843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787393001.998943:0:5843:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787393001.999002:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000074f31fd9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:5843:1874217338406144:0@lo:502: 00000100:00100000:0.0:1787393001.999094:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393001.999150:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338406144 00000100:00100000:1.0:1787393001.999158:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338406144 00000100:00100000:1.0:1787393001.999210:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787393001.999229:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebb2cfdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+9:5843:x1874217338406144:12345-0@lo:502: 00000100:00100000:1.0:1787393001.999569:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebb2cfdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+9:5843:x1874217338406144:12345-0@lo:502: Request processed in 342us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393001.999577:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787393001.999660:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set 00000000469a46c7 going to sleep for 11 seconds 00000100:00100000:1.0:1787393001.999688:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000074f31fd9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:5843:1874217338406144:0@lo:502: 00000020:01000000:1.0:1787393001.999715:0:5843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787393001.999720:0:5843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393001.999722:0:5843:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787393001.999726:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787393002.000520:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787393002.000541:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787393002.000564:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 000000008926808b/0x19a927d9c62f108d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1094 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.000576:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 000000008926808b/0x19a927d9c62f108d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1094 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393002.000583:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9de804ca6000 from 1 10000000:01000000:0.0:1787393002.000586:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787393002.000620:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 00000000cc5f3786/0x19a927d9c62f10e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.000640:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 00000000cc5f3786/0x19a927d9c62f10e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.000649:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 00000000cc5f3786/0x19a927d9c62f10e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393002.000666:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e326eeda pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338406272:0@lo:101: 00000100:00100000:0.0:1787393002.000720:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393002.000755:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000db8fb353 going to sleep for 11 seconds 00000100:00100000:1.0:1787393002.001468:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338406272 00000100:00100000:1.0:1787393002.001477:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338406272 00000100:00100000:1.0:1787393002.001518:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787393002.001525:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034112b69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+9:5801:x1874217338406272:12345-0@lo:101: 00010000:00010000:1.0:1787393002.001546:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393002.001560:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000630b867f/0x19a927d9c62f10e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f10e1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393002.001580:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000630b867f/0x19a927d9c62f10e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f10e1 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393002.001589:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000630b867f/0x19a927d9c62f10e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f10e1 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393002.001597:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000630b867f, rc 0) 00000100:00100000:1.0:1787393002.001642:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034112b69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+10:5801:x1874217338406272:12345-0@lo:101: Request processed in 118us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393002.001653:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787393002.001679:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e326eeda pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338406272:0@lo:101: 00010000:00010000:0.0:1787393002.001694:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 00000000cc5f3786/0x19a927d9c62f10e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f10e8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.001948:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 00000000cc5f3786/0x19a927d9c62f10e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f10e8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393002.002629:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e326eeda pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338406400:0@lo:256: 00000100:00100000:0.0:1787393002.002682:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393002.003162:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000db8fb353 going to sleep for 11 seconds 00000100:00100000:3.0:1787393002.003297:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338406400 00000100:00100000:3.0:1787393002.003303:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338406400 00000100:00100000:3.0:1787393002.004274:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787393002.004289:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ed2f6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+10:5801:x1874217338406400:12345-0@lo:256: 20000000:01000000:3.0:1787393002.004311:0:5815:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787393002.004329:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787393002.004632:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ed2f6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+10:5801:x1874217338406400:12345-0@lo:256: Request processed in 347us (1948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393002.004641:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787393002.004755:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e326eeda pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338406400:0@lo:256: 10000000:01000000:0.0:1787393002.005404:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787393002.005432:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 00000000cc5f3786/0x19a927d9c62f10e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f10e8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.005745:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 00000000cc5f3786/0x19a927d9c62f10e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f10e8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393002.005767:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de804ca6000 from 1 10000000:01000000:0.0:1787393002.005770:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787393002.005799:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 000000007d425c22/0x19a927d9c62f10ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.005863:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 000000007d425c22/0x19a927d9c62f10ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.005872:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 000000007d425c22/0x19a927d9c62f10ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393002.005934:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e326eeda pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338406528:0@lo:101: 00000100:00100000:0.0:1787393002.006031:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393002.006062:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000db8fb353 going to sleep for 11 seconds 00000100:00100000:1.0:1787393002.006515:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338406528 00000100:00100000:1.0:1787393002.006523:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338406528 00000100:00100000:1.0:1787393002.006638:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787393002.006646:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023a967c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+10:5801:x1874217338406528:12345-0@lo:101: 00010000:00010000:1.0:1787393002.006658:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393002.006670:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ffe7d33e/0x19a927d9c62f10f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f10ef expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393002.006700:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ffe7d33e/0x19a927d9c62f10f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f10ef expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393002.006710:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ffe7d33e/0x19a927d9c62f10f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f10ef expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393002.006719:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ffe7d33e, rc 0) 00000100:00100000:1.0:1787393002.006767:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023a967c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+11:5801:x1874217338406528:12345-0@lo:101: Request processed in 122us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393002.006774:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787393002.007143:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e326eeda pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338406528:0@lo:101: 00010000:00010000:0.0:1787393002.007160:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 000000007d425c22/0x19a927d9c62f10ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f10f6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.007169:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 000000007d425c22/0x19a927d9c62f10ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f10f6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393002.007237:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e326eeda pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338406656:0@lo:501: 00000100:00100000:0.0:1787393002.007268:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393002.007300:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000db8fb353 going to sleep for 11 seconds 00000100:00100000:3.0:1787393002.008273:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338406656 00000100:00100000:3.0:1787393002.008281:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338406656 00000100:00100000:3.0:1787393002.008327:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787393002.008334:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc9d8671 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+11:5801:x1874217338406656:12345-0@lo:501: 00000100:00100000:3.0:1787393002.009357:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc9d8671 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+11:5801:x1874217338406656:12345-0@lo:501: Request processed in 1021us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393002.009367:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787393002.009637:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e326eeda pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338406656:0@lo:501: 00000100:00100000:0.0:1787393002.009685:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e326eeda pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338406784:0@lo:503: 00000100:00100000:0.0:1787393002.009738:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393002.009772:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000db8fb353 going to sleep for 11 seconds 00000100:00100000:1.0:1787393002.011183:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338406784 00000100:00100000:1.0:1787393002.011193:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338406784 00000100:00100000:1.0:1787393002.011265:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787393002.011273:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2bc34c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+11:5801:x1874217338406784:12345-0@lo:503: 00000040:00080000:1.0:1787393002.011327:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787393002.011395:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2bc34c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+11:5801:x1874217338406784:12345-0@lo:503: Request processed in 122us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393002.011402:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787393002.011673:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e326eeda pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338406784:0@lo:503: 00000040:00080000:3.0:1787393002.012582:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787393002.012654:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787393002.012676:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787393002.012738:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 000000007d425c22/0x19a927d9c62f10ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f10f6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.012749:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 000000007d425c22/0x19a927d9c62f10ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f10f6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393002.012786:0:5801:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787393002.012788:0:5801:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9de804ca6000 10000000:01000000:0.0:1787393002.012791:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9de804ca6000 10000000:01000000:0.0:1787393002.012794:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787393002.012799:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9de804ca6000 from 1 10000000:01000000:0.0:1787393002.012810:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787393002.012857:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 00000000f82745bc/0x19a927d9c62f10fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.012864:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 00000000f82745bc/0x19a927d9c62f10fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.012871:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 00000000f82745bc/0x19a927d9c62f10fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393002.012888:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e326eeda pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338406912:0@lo:101: 00000100:00100000:0.0:1787393002.012935:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393002.012967:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eb41e5b9 going to sleep for 11 seconds 00000100:00100000:3.0:1787393002.013225:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338406912 00000100:00100000:3.0:1787393002.013232:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338406912 00000100:00100000:3.0:1787393002.013270:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787393002.013279:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001336e56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+11:5801:x1874217338406912:12345-0@lo:101: 00010000:00010000:3.0:1787393002.013292:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393002.013304:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000076aa4c69/0x19a927d9c62f1104 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f10fd expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393002.013327:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000076aa4c69/0x19a927d9c62f1104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f10fd expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393002.013337:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000076aa4c69/0x19a927d9c62f1104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f10fd expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393002.013345:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000076aa4c69, rc 0) 00000100:00100000:3.0:1787393002.013387:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001336e56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5801:x1874217338406912:12345-0@lo:101: Request processed in 111us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393002.013403:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787393002.013564:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e326eeda pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338406912:0@lo:101: 00010000:00010000:0.0:1787393002.013577:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 00000000f82745bc/0x19a927d9c62f10fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1104 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.013585:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 00000000f82745bc/0x19a927d9c62f10fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f1104 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393002.013629:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e326eeda pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338407040:0@lo:501: 00000100:00100000:0.0:1787393002.013655:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393002.013682:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eb41e5b9 going to sleep for 11 seconds 00000100:00100000:3.0:1787393002.013946:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338407040 00000100:00100000:3.0:1787393002.013951:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338407040 00000100:00100000:3.0:1787393002.013975:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787393002.013981:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059f6ce02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5801:x1874217338407040:12345-0@lo:501: 00000100:00100000:3.0:1787393002.014278:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059f6ce02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5801:x1874217338407040:12345-0@lo:501: Request processed in 297us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393002.014286:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787393002.018323:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e326eeda pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338407040:0@lo:501: 00000100:00100000:1.0:1787393002.018407:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000479193d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338407168:0@lo:503: 00000100:00100000:1.0:1787393002.018485:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393002.018535:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f9f5f124 going to sleep for 11 seconds 00000100:00100000:3.0:1787393002.018603:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338407168 00000100:00100000:3.0:1787393002.018610:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338407168 00000100:00100000:3.0:1787393002.018665:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787393002.018673:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbd7803b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5801:x1874217338407168:12345-0@lo:503: 00000100:00100000:3.0:1787393002.019031:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbd7803b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5801:x1874217338407168:12345-0@lo:503: Request processed in 359us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393002.019039:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787393002.019140:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000479193d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338407168:0@lo:503: 00000100:00100000:0.0:1787393002.019672:0:5848:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005ae147bd pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:5848:1874217338407296:0@lo:502: 00000100:00100000:0.0:1787393002.019718:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393002.019758:0:5848:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eb41e5b9 going to sleep for 11 seconds 00000100:00100000:3.0:1787393002.019806:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338407296 00000100:00100000:3.0:1787393002.019812:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338407296 00000100:00100000:3.0:1787393002.019874:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787393002.019881:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7f6dfc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5848:x1874217338407296:12345-0@lo:502: 00000100:00100000:3.0:1787393002.020041:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7f6dfc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5848:x1874217338407296:12345-0@lo:502: Request processed in 162us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393002.020046:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787393002.020495:0:5848:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005ae147bd pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:5848:1874217338407296:0@lo:502: 00000020:01000004:0.0:1787393002.020550:0:5848:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787393002.020562:0:5848:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000060e80e10) 00000020:00000080:0.0:1787393002.020581:0:5848:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787393002.020782:0:5848:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000066da7754 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787393002.020787:0:5848:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000066da7754 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787393002.020789:0:5848:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000066da7754 4 00010000:00080000:0.0:1787393002.020814:0:5848:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003af4dc38@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.121@tcp at head 00010000:00010000:0.0:1787393002.022465:0:5848:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787393002.022570:0:5848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787393002.022604:0:5848:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787393002.022616:0:5848:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x19a927d9c62f1112 00000100:00080000:0.0:1787393002.022625:0:5848:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787393002.022636:0:5848:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003af4dc38 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:0.0:1787393002.022669:0:5848:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005ae147bd x1874217338407424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787393002.022757:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005ae147bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3323:1874217338407424:0@lo:38: 00000100:00100000:2.0:1787393002.022818:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393002.023324:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338407424 00000100:00100000:1.0:1787393002.023332:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338407424 00000100:00100000:1.0:1787393002.023372:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787393002.023378:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe1170e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3323:x1874217338407424:12345-0@lo:38: 00000100:00080000:0.0:1787393002.023481:0:5848:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787393002.023785:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe1170e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3323:x1874217338407424:12345-0@lo:38: Request processed in 405us (966us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787393002.023794:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787393002.028246:0:5848:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000133c13a3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:5848:1874217338407552:0@lo:502: 00000100:00100000:0.0:1787393002.028324:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393002.028368:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338407552 00000100:00100000:0.0:1787393002.028375:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338407552 00000100:00100000:0.0:1787393002.028415:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787393002.028423:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1ba040d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5848:x1874217338407552:12345-0@lo:502: 00000100:00100000:0.0:1787393002.028639:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1ba040d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5848:x1874217338407552:12345-0@lo:502: Request processed in 217us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393002.028648:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787393002.028700:0:5848:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eb41e5b9 going to sleep for 11 seconds 00000100:00100000:0.0:1787393002.028722:0:5848:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000133c13a3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:5848:1874217338407552:0@lo:502: 00000040:00080000:0.0:1787393002.028746:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1787393002.028982:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1787393002.029002:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787393002.029027:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 00000000f82745bc/0x19a927d9c62f10fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1104 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393002.029050:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 00000000f82745bc/0x19a927d9c62f10fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1104 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787393002.029157:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787393002.029160:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787393002.029161:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787393002.029162:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787393002.029163:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787393002.029165:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787393002.029166:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787393002.029167:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787393002.029168:0:5801:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787393002.029170:0:5801:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787393002.029171:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787393002.029173:0:5801:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787393002.029176:0:5801:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1787393002.029179:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787393002.029180:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787393002.029182:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787393002.029183:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787393002.029184:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787393002.029185:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787393002.029186:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787393002.029187:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787393002.029188:0:5801:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787393002.029189:0:5801:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787393002.029190:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787393002.029191:0:5801:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787393002.029206:0:5801:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787393002.029225:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004801b5a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338407680:0@lo:253: 00000100:00100000:3.0:1787393002.029260:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393002.029282:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 0000000081f8a8b2 going to sleep for 11 seconds 00000100:00100000:0.0:1787393002.029347:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338407680 00000100:00100000:0.0:1787393002.029352:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338407680 00000100:00100000:0.0:1787393002.029386:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787393002.029392:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045eb45c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5801:x1874217338407680:12345-0@lo:253: 20000000:01000000:0.0:1787393002.029409:0:5815:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787393002.029421:0:5815:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787393002.030521:0:3323:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787393002.030529:0:3323:0:(import.c:65:import_set_state_nolock()) 000000003af4dc38 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787393002.030535:0:3323:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787393002.030538:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005ae147bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3323:1874217338407424:0@lo:38: 20000000:01000000:1.0:1787393002.069832:0:5815:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787393002.069941:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787393002.070015:0:5836:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787393002.070020:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787393002.070038:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007ab8ff9b/0x19a927d9c62f1119 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393002.070066:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000630b867f/0x19a927d9c62f10e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f10e1 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393002.070074:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007ab8ff9b/0x19a927d9c62f1119 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393002.070116:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000630b867f/0x19a927d9c62f10e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f10e1 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393002.070129:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000630b867f/0x19a927d9c62f10e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f10e1 expref: 12 pid: 5814 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393002.070143:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bfc97fc5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5836:1874217338407808:0@lo:104: 00000100:00100000:3.0:1787393002.070203:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393002.070269:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set 000000002a6a3c77 going to sleep for 11 seconds 00000100:00100000:2.0:1787393002.070512:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338407808 00000100:00100000:2.0:1787393002.070521:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338407808 00000100:00100000:2.0:1787393002.070566:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787393002.070575:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000afd8d79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+3:5836:x1874217338407808:12345-0@lo:104: 00010000:00010000:2.0:1787393002.070586:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: 00000000cc5f3786/0x19a927d9c62f10e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f10e8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393002.070649:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787393002.070654:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000afd8d79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+3:5836:x1874217338407808:12345-0@lo:104: Request processed in 82us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393002.070661:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787393002.070796:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bfc97fc5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5836:1874217338407808:0@lo:104: 00010000:00010000:3.0:1787393002.070814:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007ab8ff9b/0x19a927d9c62f1119 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.070922:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393002.070927:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: 00000000cc5f3786/0x19a927d9c62f10e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f10e8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.070934:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cc5f3786 already unused, calling callback (000000009c025a36) 10000000:00010000:0.0:1787393002.070945:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: 00000000cc5f3786/0x19a927d9c62f10e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f10e8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.070952:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: 00000000cc5f3786/0x19a927d9c62f10e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f10e8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787393002.070958:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: 00000000cc5f3786/0x19a927d9c62f10e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f10e8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393002.070963:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787393002.071035:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: 00000000cc5f3786/0x19a927d9c62f10e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f10e8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.071042:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787393002.071066:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: 00000000cc5f3786/0x19a927d9c62f10e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f10e8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.071072:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: 00000000cc5f3786/0x19a927d9c62f10e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f10e8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.071099:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393002.071101:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393002.071103:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393002.071185:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000133c13a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338407936:0@lo:103: 00000100:00100000:3.0:1787393002.071229:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393002.071501:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338407936 00000100:00100000:0.0:1787393002.071506:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338407936 00010000:00010000:0.0:1787393002.071524:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000630b867f/0x19a927d9c62f10e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f10e1 expref: 13 pid: 5814 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393002.071552:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787393002.071557:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfc97fc5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:3325:x1874217338407936:12345-0@lo:103: 00010000:00010000:0.0:1787393002.071566:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393002.071575:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000630b867f/0x19a927d9c62f10e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f10e1 expref: 13 pid: 5814 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.071584:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000630b867f/0x19a927d9c62f10e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f10e1 expref: 13 pid: 5814 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.071595:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000630b867f/0x19a927d9c62f10e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f10e1 expref: 13 pid: 5814 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.071607:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007ab8ff9b/0x19a927d9c62f1119 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.071613:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ab8ff9b/0x19a927d9c62f1119 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787393002.071624:0:5805:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001604933s 00010000:00010000:0.0:1787393002.071627:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007ab8ff9b/0x19a927d9c62f1119 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.071634:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007ab8ff9b/0x19a927d9c62f1119 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.071639:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007ab8ff9b/0x19a927d9c62f1119 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.071644:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007ab8ff9b/0x19a927d9c62f1119 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.071649:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007ab8ff9b already unused, calling callback (00000000549419c9) 00010000:00010000:0.0:1787393002.071652:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007ab8ff9b/0x19a927d9c62f1119 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.071658:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007ab8ff9b/0x19a927d9c62f1119 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.071672:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007ab8ff9b/0x19a927d9c62f1119 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393002.071681:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393002.071707:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfc97fc5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:3325:x1874217338407936:12345-0@lo:103: Request processed in 151us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393002.071714:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787393002.071779:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000133c13a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338407936:0@lo:103: 00010000:00010000:3.0:1787393002.071796:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007ab8ff9b/0x19a927d9c62f1119 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393002.071802:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007ab8ff9b/0x19a927d9c62f1119 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393002.071817:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007ab8ff9b/0x19a927d9c62f1119 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393002.083792:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045eb45c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+11:5801:x1874217338407680:12345-0@lo:253: Request processed in 54393us (54524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393002.083808:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787393002.083925:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004801b5a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:5801:1874217338407680:0@lo:253: 10000000:01000000:3.0:1787393002.083939:0:5801:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787393002.083942:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787393002.083944:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787393002.083946:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787393002.083947:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787393002.083948:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787393002.083949:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787393002.083951:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787393002.083952:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787393002.083954:0:5801:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787393002.083955:0:5801:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787393002.083956:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787393002.083958:0:5801:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787393002.083971:0:5801:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787393002.089726:0:5801:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787393002.090193:0:5801:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787393002.090553:0:5801:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787393002.090735:0:5801:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787393002.090977:0:5801:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787393002.091173:0:5801:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787393002.092294:0:5801:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787393002.092573:0:5801:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787393002.092787:0:5801:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787393002.093014:0:5801:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787393002.093316:0:5801:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787393002.093585:0:5801:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1787393002.136206:0:5801:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1787393002.162336:0:5801:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787393002.162861:0:5854:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787393002.166004:0:5801:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787393002.166232:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787393002.166647:0:5801:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787393002.166654:0:5801:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787393002.166785:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787393002.167265:0:5853:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787393002.167270:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:0.0:1787393002.171906:0:5801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787393002.172375:0:5801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787393002.172404:0:5801:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787393002.172660:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787393002.172875:0:5801:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1787393002.176485:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787393002.176630:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787393002.176878:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787393002.177386:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787393002.177553:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787393002.177792:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787393002.178190:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787393002.178932:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787393002.179449:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787393002.179613:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787393002.179836:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787393002.180078:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787393002.180495:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787393002.180654:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787393002.180905:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787393002.181312:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787393002.181705:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787393002.184447:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787393002.184591:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787393002.184770:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787393002.184939:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787393002.185087:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787393002.186952:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787393002.188187:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787393002.188384:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787393002.188528:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787393002.188681:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787393002.188818:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787393002.189032:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787393002.189169:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787393002.189348:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787393002.189491:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787393002.189715:0:5801:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787393002.204690:0:5854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1787393002.255415:0:5801:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787393002.255457:0:5801:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbe5881daf988 00100000:10000000:0.0:1787393002.255465:0:5801:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787393002.256163:0:5801:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787393002.256177:0:5801:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.121@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787393002.256201:0:5801:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787393002.256236:0:5801:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1787393002.334920:0:5854:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787393002.334997:0:5854:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787393002.335013:0:5854:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787393002.986165:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393004.008146:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393005.032725:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787393006.055910:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787393006.055918:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9de804ca6000 from 3 10000000:01000000:1.0:1787393006.055923:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787393006.055970:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 0000000071ecdb34/0x19a927d9c62f1120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393006.055983:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 0000000071ecdb34/0x19a927d9c62f1120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393006.055992:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 0000000071ecdb34/0x19a927d9c62f1120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393006.056016:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ec39e992 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338408064:0@lo:101: 00000100:00100000:1.0:1787393006.056082:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393006.056126:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 00000000564a738d going to sleep for 11 seconds 00000100:00100000:0.0:1787393006.056219:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338408064 00000100:00100000:0.0:1787393006.056227:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338408064 00000100:00100000:0.0:1787393006.056281:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787393006.056288:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c9346fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+11:5818:x1874217338408064:12345-0@lo:101: 00010000:00010000:0.0:1787393006.056301:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393006.056319:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008332cc06/0x19a927d9c62f1127 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f1120 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393006.056340:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008332cc06/0x19a927d9c62f1127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f1120 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393006.056350:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008332cc06/0x19a927d9c62f1127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1120 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393006.056358:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008332cc06, rc 0) 00000100:00100000:0.0:1787393006.056397:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c9346fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5818:x1874217338408064:12345-0@lo:101: Request processed in 110us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393006.056404:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787393006.056455:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393006.056476:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ec39e992 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338408064:0@lo:101: 00010000:00010000:0.0:1787393006.056489:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 0000000071ecdb34/0x19a927d9c62f1120 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1127 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393006.056496:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 0000000071ecdb34/0x19a927d9c62f1120 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f1127 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393006.056539:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000092c2660 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338408192:0@lo:256: 00000100:00100000:0.0:1787393006.056569:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393006.056582:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 000000002d38cdf2 going to sleep for 11 seconds 00000100:00100000:0.0:1787393006.056593:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338408192 00000100:00100000:0.0:1787393006.056596:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338408192 00000100:00100000:0.0:1787393006.056613:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787393006.056618:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067eb1eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5818:x1874217338408192:12345-0@lo:256: 20000000:01000000:0.0:1787393006.056629:0:5815:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787393006.056648:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787393006.056651:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787393006.056715:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067eb1eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5818:x1874217338408192:12345-0@lo:256: Request processed in 97us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393006.056721:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787393006.056746:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000092c2660 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338408192:0@lo:256: 10000000:01000000:0.0:1787393006.056779:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787393006.056784:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 0000000071ecdb34/0x19a927d9c62f1120 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1127 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393006.056790:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 0000000071ecdb34/0x19a927d9c62f1120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1127 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1787393006.619109:0:6096:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787393007.080001:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787393007.474133:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787393007.474143:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787393007.474146:0:36:0:(import.c:65:import_set_state_nolock()) 000000003af4dc38 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787393007.474157:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003af4dc38 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:1.0:1787393007.474203:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000515ab79f x1874217338408448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787393007.474426:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787393007.474441:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d0e73a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338408320:0@lo:400: 00000100:00100000:1.0:1787393007.474503:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393007.474553:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000515ab79f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3323:1874217338408448:0@lo:38: 00000100:00100000:1.0:1787393007.474636:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393007.474678:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338408320 00000100:00100000:1.0:1787393007.474697:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338408320 00000100:00100000:1.0:1787393007.474737:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787393007.474744:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e6cd2e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:3327:x1874217338408320:12345-0@lo:400: 00000100:00100000:1.0:1787393007.474790:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e6cd2e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:3327:x1874217338408320:12345-0@lo:400: Request processed in 47us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393007.474796:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787393007.474872:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d0e73a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338408320:0@lo:400: 00000100:00100000:1.0:1787393007.477004:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338408448 00000100:00100000:1.0:1787393007.477016:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338408448 00000100:00100000:2.0:1787393007.477147:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787393007.477155:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060d03632 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3323:x1874217338408448:12345-0@lo:38: 00010000:00080000:2.0:1787393007.477190:0:5821:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:2.0:1787393007.477226:0:5821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x19a927d9c62f112e 00000004:00100000:2.0:1787393007.477265:0:5821:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787393007.477446:0:5821:0:(import.c:65:import_set_state_nolock()) 000000000e0032d2 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787393007.477524:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060d03632 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1874217338408448:12345-0@lo:38: Request processed in 368us (2887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393007.477532:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787393007.477608:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000515ab79f x1874217338408448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787393017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787393007.477623:0:3323:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787393007.477630:0:3323:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787393007.477635:0:3323:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787393007.477637:0:3323:0:(import.c:65:import_set_state_nolock()) 000000003af4dc38 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787393007.477643:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000515ab79f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3323:1874217338408448:0@lo:38: 00010000:00010000:0.0:1787393008.104977:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393009.127973:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393010.152221:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393011.186780:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787393011.744210:0:6298:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffea5d61ec0 00000020:00000080:1.0:1787393011.744226:0:6298:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787393011.744237:0:6298:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787393011.744246:0:6298:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea5d64150 20000000:00000080:1.0:1787393011.744252:0:6298:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9de82dc70800 uarg=0000000000000000 20000000:01000000:1.0:1787393011.744422:0:6298:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787393011.744429:0:6298:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787393011.744433:0:6298:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787393011.744700:0:6298:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787393011.744712:0:6298:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787393011.750022:0:6298:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787393011.750269:0:6298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787393011.750339:0:6298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787393011.750404:0:6298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787393011.750423:0:6298:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787393011.750441:0:6298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000224a304b/0x19a927d9c62f1135 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393011.750458:0:6298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ffe7d33e/0x19a927d9c62f10f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f10ef expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393011.750466:0:6298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000224a304b/0x19a927d9c62f1135 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393011.750505:0:6298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ffe7d33e/0x19a927d9c62f10f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f10ef expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393011.750520:0:6298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ffe7d33e/0x19a927d9c62f10f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f10ef expref: 11 pid: 5814 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393011.750532:0:6298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000515ab79f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6298:1874217338408576:0@lo:104: 00000100:00100000:1.0:1787393011.750597:0:6298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393011.750651:0:6298:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ab4ba72d going to sleep for 11 seconds 00000100:00100000:0.0:1787393011.750957:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338408576 00000100:00100000:0.0:1787393011.750965:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338408576 00000100:00100000:0.0:1787393011.751015:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787393011.751021:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d0e73a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:6298:x1874217338408576:12345-0@lo:104: 00010000:00010000:0.0:1787393011.751032:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: 000000007d425c22/0x19a927d9c62f10ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f10f6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393011.751083:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787393011.751088:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d0e73a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:6298:x1874217338408576:12345-0@lo:104: Request processed in 67us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393011.751093:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787393011.751111:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393011.751115:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: 000000007d425c22/0x19a927d9c62f10ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f10f6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393011.751128:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007d425c22 already unused, calling callback (000000009c025a36) 10000000:00010000:0.0:1787393011.751131:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: 000000007d425c22/0x19a927d9c62f10ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f10f6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393011.751137:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: 000000007d425c22/0x19a927d9c62f10ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f10f6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787393011.751142:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: 000000007d425c22/0x19a927d9c62f10ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f10f6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393011.751156:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787393011.751182:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: 000000007d425c22/0x19a927d9c62f10ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f10f6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393011.751188:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787393011.751204:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: 000000007d425c22/0x19a927d9c62f10ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f10f6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393011.751209:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: 000000007d425c22/0x19a927d9c62f10ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f10f6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393011.751224:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393011.751226:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393011.751227:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393011.751243:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000092c2660 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338408704:0@lo:103: 00000100:00100000:0.0:1787393011.751271:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393011.751319:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338408704 00000100:00100000:0.0:1787393011.751323:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338408704 00010000:00010000:0.0:1787393011.751339:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ffe7d33e/0x19a927d9c62f10f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f10ef expref: 12 pid: 5814 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393011.751369:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787393011.751375:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000441c719c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:3327:x1874217338408704:12345-0@lo:103: 00010000:00010000:0.0:1787393011.751383:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393011.751387:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ffe7d33e/0x19a927d9c62f10f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f10ef expref: 12 pid: 5814 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393011.751395:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ffe7d33e/0x19a927d9c62f10f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f10ef expref: 12 pid: 5814 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393011.751409:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000224a304b/0x19a927d9c62f1135 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393011.751415:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000224a304b/0x19a927d9c62f1135 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393011.751424:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000224a304b/0x19a927d9c62f1135 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393011.751430:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000224a304b/0x19a927d9c62f1135 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393011.751436:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000224a304b/0x19a927d9c62f1135 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393011.751441:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000224a304b/0x19a927d9c62f1135 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393011.751446:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000224a304b already unused, calling callback (00000000549419c9) 00010000:00010000:0.0:1787393011.751448:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000224a304b/0x19a927d9c62f1135 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393011.751459:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000224a304b/0x19a927d9c62f1135 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393011.751466:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000224a304b/0x19a927d9c62f1135 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393011.751475:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393011.751500:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000441c719c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:3327:x1874217338408704:12345-0@lo:103: Request processed in 126us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393011.751506:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787393011.751534:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000092c2660 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338408704:0@lo:103: 00010000:00010000:1.0:1787393011.751735:0:6298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ffe7d33e/0x19a927d9c62f10f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f10ef expref: 11 pid: 5814 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393011.751750:0:6298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000515ab79f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6298:1874217338408576:0@lo:104: 00010000:00010000:1.0:1787393011.751762:0:6298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000224a304b/0x19a927d9c62f1135 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393011.751769:0:6298:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000224a304b/0x19a927d9c62f1135 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393011.751774:0:6298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000224a304b/0x19a927d9c62f1135 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393011.751780:0:6298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000224a304b/0x19a927d9c62f1135 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393012.200078:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393012.584039:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004234156b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338408960:0@lo:400: 00000100:00100000:1.0:1787393012.584111:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393012.584182:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787393012.584188:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000515ab79f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338408832:0@lo:400: 00000100:00100000:1.0:1787393012.584215:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393012.584245:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338408960 00000100:00100000:1.0:1787393012.584252:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338408960 00000100:00100000:0.0:1787393012.584282:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338408832 00000100:00100000:0.0:1787393012.584286:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338408832 00000100:00100000:1.0:1787393012.584300:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787393012.584307:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036690805 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338408960:12345-0@lo:400: 00000100:00100000:0.0:1787393012.584309:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787393012.584313:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5653b76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+11:3325:x1874217338408832:12345-0@lo:400: 00000100:00100000:0.0:1787393012.584358:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5653b76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+11:3325:x1874217338408832:12345-0@lo:400: Request processed in 43us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393012.584364:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787393012.592224:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000515ab79f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338408832:0@lo:400: 00000100:00100000:1.0:1787393012.592226:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036690805 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338408960:12345-0@lo:400: Request processed in 7917us (8112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393012.592241:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787393012.592509:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004234156b x1874217338408960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393012.592523:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004234156b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338408960:0@lo:400: 00010000:00010000:0.0:1787393013.223959:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787393013.938972:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787393013.938980:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de804ca6000 from 1 10000000:01000000:1.0:1787393013.938997:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787393013.939049:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 000000005d1931f0/0x19a927d9c62f113c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393013.940521:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 000000005d1931f0/0x19a927d9c62f113c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393013.940536:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 000000005d1931f0/0x19a927d9c62f113c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393013.940564:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000979543e5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338409088:0@lo:101: 00000100:00100000:1.0:1787393013.940626:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393013.940715:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d35c42b2 going to sleep for 11 seconds 00000100:00100000:0.0:1787393013.940759:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338409088 00000100:00100000:0.0:1787393013.940767:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338409088 00000100:00100000:0.0:1787393013.940873:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787393013.940882:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ff7cc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+11:5818:x1874217338409088:12345-0@lo:101: 00010000:00010000:0.0:1787393013.940896:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393013.940914:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fa773053/0x19a927d9c62f1143 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f113c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393013.940945:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa773053/0x19a927d9c62f1143 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f113c expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393013.940955:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fa773053/0x19a927d9c62f1143 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f113c expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393013.940963:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fa773053, rc 0) 00000100:00100000:0.0:1787393013.941011:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ff7cc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5818:x1874217338409088:12345-0@lo:101: Request processed in 130us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393013.941018:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787393013.941109:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000979543e5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338409088:0@lo:101: 00010000:00010000:2.0:1787393013.941123:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 000000005d1931f0/0x19a927d9c62f113c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1143 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393013.941131:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 000000005d1931f0/0x19a927d9c62f113c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f1143 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393013.941198:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c6116fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338409216:0@lo:501: 00000100:00100000:2.0:1787393013.941225:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393013.945940:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 00000000956ac0f9 going to sleep for 11 seconds 00000100:00100000:1.0:1787393013.948325:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338409216 00000100:00100000:1.0:1787393013.948342:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338409216 00000100:00100000:1.0:1787393013.948394:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787393013.948403:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d71eb65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5818:x1874217338409216:12345-0@lo:501: 00000100:00100000:1.0:1787393013.948676:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d71eb65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5818:x1874217338409216:12345-0@lo:501: Request processed in 274us (7450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393013.948683:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787393013.953229:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c6116fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338409216:0@lo:501: 00000100:00100000:2.0:1787393013.953360:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c6116fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338409344:0@lo:503: 00000100:00100000:2.0:1787393013.953428:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393013.953471:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 00000000956ac0f9 going to sleep for 11 seconds 00000100:00100000:0.0:1787393013.953630:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338409344 00000100:00100000:0.0:1787393013.953638:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338409344 00000100:00100000:0.0:1787393013.953688:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787393013.953697:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f87282a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5818:x1874217338409344:12345-0@lo:503: 00000100:00100000:0.0:1787393013.953926:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f87282a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5818:x1874217338409344:12345-0@lo:503: Request processed in 230us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393013.953935:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787393013.955503:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c6116fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338409344:0@lo:503: 00000100:00100000:1.0:1787393013.956829:0:6376:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f955e366 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:6376:1874217338409472:0@lo:502: 00000100:00100000:1.0:1787393013.956914:0:6376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393013.956955:0:6376:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b94719c8 going to sleep for 11 seconds 00000100:00100000:2.0:1787393013.957043:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338409472 00000100:00100000:2.0:1787393013.957050:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338409472 00000100:00100000:2.0:1787393013.957170:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787393013.957178:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049931826 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6376:x1874217338409472:12345-0@lo:502: 00000100:00100000:2.0:1787393013.957496:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049931826 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6376:x1874217338409472:12345-0@lo:502: Request processed in 318us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393013.957504:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787393013.962482:0:6376:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f955e366 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:6376:1874217338409472:0@lo:502: 00000020:01000000:1.0:1787393013.962522:0:6376:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787393013.962531:0:6376:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393013.962534:0:6376:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787393013.962541:0:6376:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9de804ca6000 00000020:00000080:1.0:1787393013.962544:0:6376:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787393013.962596:0:6376:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:6376:1874217338409600:0@lo:502: 00000100:00100000:1.0:1787393013.962655:0:6376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393013.962685:0:6376:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de84186cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787393013.962859:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338409600 00000100:00100000:0.0:1787393013.962865:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338409600 00000100:00100000:0.0:1787393013.962910:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787393013.962918:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6376:x1874217338409600:12345-0@lo:502: 00000100:00100000:0.0:1787393013.963119:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6376:x1874217338409600:12345-0@lo:502: Request processed in 200us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393013.963127:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787393013.963487:0:6376:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:6376:1874217338409600:0@lo:502: 00000020:01000000:1.0:1787393013.963508:0:6376:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787393013.963513:0:6376:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393013.963515:0:6376:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787393013.963519:0:6376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787393013.963655:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787393013.963675:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787393013.963684:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d9c00/0x19a927d9c62f113c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1143 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393013.963696:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8040d9c00/0x19a927d9c62f113c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1143 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393014.250944:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393015.271993:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393016.298563:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787393017.241305:0:6620:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787393017.241311:0:6620:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787393017.241481:0:6620:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9de83d423000 00000020:01000004:2.0:1787393017.241502:0:6620:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787393017.241517:0:6620:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787393017.241535:0:6620:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9de8103c4d40) 00000020:00000080:2.0:1787393017.241558:0:6620:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787393017.289955:0:6620:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787393017.290200:0:6620:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00010000:00010000:0.0:1787393017.319987:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787393017.338918:0:6620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787393017.343786:0:6620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787393017.343823:0:6620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787393017.343976:0:6620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787393017.344002:0:6620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787393017.344470:0:6620:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787393017.344480:0:6620:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787393017.344491:0:6620:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x19a927d9c62f1151 00000020:01000004:3.0:1787393017.344497:0:6620:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787393017.344517:0:6620:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.121@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787393017.344521:0:6620:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787393017.344527:0:6620:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787393017.344538:0:6620:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787393017.344556:0:6620:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9de834ed4d40) 00000020:00000080:3.0:1787393017.344568:0:6620:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787393017.346197:0:6620:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787393017.346469:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787393017.346475:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787393017.351572:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787393017.351596:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787393017.352003:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787393017.352010:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787393017.357098:0:6620:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787393017.359128:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787393017.359139:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787393017.360714:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787393017.360725:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787393017.392363:0:6620:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787393017.393182:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787393017.393205:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787393017.395681:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787393017.395695:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787393017.396595:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787393017.396603:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787393017.404518:0:6620:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787393017.404723:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787393017.404730:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787393017.405702:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787393017.405711:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787393017.472162:0:6620:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787393017.472475:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787393017.472482:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787393017.473624:0:6620:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787393017.473634:0:6620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787393017.474340:0:6620:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787393017.474366:0:6620:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787393017.474372:0:6620:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.121@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787393017.492337:0:6620:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787393017.492377:0:6620:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.121@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787393017.492381:0:6620:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787393017.492383:0:6620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787393017.492384:0:6620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787393017.492386:0:6620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787393017.492387:0:6620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787393017.492388:0:6620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787393017.492389:0:6620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787393017.492391:0:6620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787393017.492392:0:6620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787393017.492398:0:6620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787393017.492399:0:6620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787393017.492402:0:6620:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787393017.492404:0:6620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787393017.492405:0:6620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787393017.492406:0:6620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787393017.492407:0:6620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787393017.492408:0:6620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787393017.492409:0:6620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787393017.492410:0:6620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787393017.492411:0:6620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787393017.492411:0:6620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787393017.492412:0:6620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787393017.492413:0:6620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787393017.492438:0:6620:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787393017.492455:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338409728:0@lo:253: 00000100:00100000:1.0:1787393017.492524:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393017.492710:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de820044a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787393017.492754:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338409728 00000100:00100000:2.0:1787393017.492761:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338409728 00000100:00100000:2.0:1787393017.492861:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787393017.492870:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6620:x1874217338409728:12345-0@lo:253: 20000000:01000000:2.0:1787393017.492906:0:5815:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787393017.492910:0:5815:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787393017.492914:0:5815:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787393017.492917:0:5815:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787393017.493730:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787393017.493981:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787393017.493995:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787393017.494037:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1787393017.494044:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787393017.494074:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1787393017.494146:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1787393017.494446:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787393017.494465:0:5815:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.121@tcp 20000000:01000000:2.0:1787393017.494467:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.121@tcp (null) (null) (null) 00000040:00080000:2.0:1787393017.494501:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787393017.494508:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787393017.494551:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787393017.494566:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.121@tcp (null) (null) 00000040:00080000:2.0:1787393017.494602:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787393017.494610:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787393017.494639:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787393017.494701:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1787393017.495438:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787393017.495457:0:5815:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.121@tcp 20000000:01000000:2.0:1787393017.495460:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.121@tcp (null) (null) (null) 00000040:00080000:2.0:1787393017.495507:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787393017.495516:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787393017.495545:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787393017.495552:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.121@tcp (null) (null) 00000040:00080000:2.0:1787393017.495599:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787393017.495608:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787393017.495642:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1787393017.495676:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1787393017.495690:0:5815:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1787393017.495692:0:5815:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1787393017.495698:0:5815:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787393017.495699:0:5815:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787393017.495701:0:5815:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787393017.495712:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787393017.495715:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787393017.495747:0:5815:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787393017.495749:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787393017.496540:0:6635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787393017.496835:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787393017.497025:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1787393017.497093:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1787393017.497118:0:5815:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787393017.497121:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787393017.497541:0:6636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787393017.497589:0:6636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787393017.497640:0:6636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1787393017.497949:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1787393017.497990:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1787393017.498024:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1787393017.498035:0:5815:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787393017.498037:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787393017.498437:0:6637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1787393017.498641:0:6637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1787393017.498692:0:6637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787393017.499029:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787393017.499086:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787393017.499171:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:0.0:1787393017.499189:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787393017.499208:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9de800031800/0x19a927d9c62f115f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393017.499226:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de801531c00/0x19a927d9c62f1078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1071 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393017.499235:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de8040d8600/0x19a927d9c62f1094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f108d expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393017.499242:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de801531000/0x19a927d9c62f1104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f10fd expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393017.499249:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9de800031800/0x19a927d9c62f115f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393017.499286:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de801531000/0x19a927d9c62f1104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f10fd expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393017.499311:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de801531000/0x19a927d9c62f1104 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f10fd expref: 12 pid: 5815 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393017.499326:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5815:1874217338409856:0@lo:104: 00000100:00100000:0.0:1787393017.499386:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787393017.499483:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de8040d8600/0x19a927d9c62f1094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f108d expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393017.499492:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de8040d8600/0x19a927d9c62f1094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f108d expref: 12 pid: 5813 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393017.499500:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5815:1874217338409984:0@lo:104: 00000100:00100000:0.0:1787393017.499521:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787393017.499614:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de801531c00/0x19a927d9c62f1078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f1071 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393017.499622:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de801531c00/0x19a927d9c62f1078 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f1071 expref: 12 pid: 5813 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393017.499631:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5815:1874217338410112:0@lo:104: 00000100:00100000:0.0:1787393017.499652:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393017.499717:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338409856 00000100:00100000:1.0:1787393017.499725:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338409856 00000100:00100000:1.0:1787393017.499758:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338409984 00000100:00100000:1.0:1787393017.499761:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338409984 00000100:00100000:1.0:1787393017.499776:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787393017.499784:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+4:5815:x1874217338409856:12345-0@lo:104: 00010000:00010000:1.0:1787393017.499795:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f10fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1104 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.499870:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787393017.499877:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+4:5815:x1874217338409856:12345-0@lo:104: Request processed in 94us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393017.499883:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787393017.499899:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787393017.499905:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:5815:x1874217338409984:12345-0@lo:104: 00010000:00010000:1.0:1787393017.499920:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de801530400/0x19a927d9c62f108d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1094 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.499959:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787393017.499965:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:5815:x1874217338409984:12345-0@lo:104: Request processed in 60us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393017.499971:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787393017.500038:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787393017.500044:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f10fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1104 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.500052:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031a00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1787393017.500056:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f10fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f1104 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.500064:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f10fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f1104 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787393017.500072:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f10fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f1104 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393017.500078:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787393017.500123:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f10fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1104 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.500129:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787393017.500147:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f10fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1104 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.500154:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f10fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1104 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.500175:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393017.500179:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de801530400/0x19a927d9c62f108d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1094 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.500184:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1787393017.500187:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de801530400/0x19a927d9c62f108d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f1094 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.500194:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de801530400/0x19a927d9c62f108d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f1094 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787393017.500200:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de801530400/0x19a927d9c62f108d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f1094 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393017.500206:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787393017.500221:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de801530400/0x19a927d9c62f108d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1094 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.500226:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787393017.500232:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de801530400/0x19a927d9c62f108d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1094 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.500238:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de801530400/0x19a927d9c62f108d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1094 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.500249:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393017.500251:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393017.500253:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393017.500266:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338410240:0@lo:103: 00000100:00100000:3.0:1787393017.500301:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393017.500330:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787393017.500337:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338410368:0@lo:103: 00000100:00100000:3.0:1787393017.500358:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393017.500389:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338410240 00000100:00100000:3.0:1787393017.500392:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338410240 00010000:00010000:3.0:1787393017.500410:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de801531000/0x19a927d9c62f1104 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f10fd expref: 13 pid: 5815 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393017.500428:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338410368 00000100:00100000:3.0:1787393017.500431:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338410368 00010000:00010000:3.0:1787393017.500442:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de8040d8600/0x19a927d9c62f1094 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f108d expref: 14 pid: 5813 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393017.500455:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787393017.500461:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835328000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+14:3326:x1874217338410240:12345-0@lo:103: 00010000:00010000:3.0:1787393017.500470:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393017.500475:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de801531000/0x19a927d9c62f1104 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f10fd expref: 14 pid: 5815 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.500485:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de801531000/0x19a927d9c62f1104 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f10fd expref: 14 pid: 5815 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.500499:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393017.500525:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835328000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+14:3326:x1874217338410240:12345-0@lo:103: Request processed in 64us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393017.500530:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787393017.500542:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787393017.500547:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+13:3326:x1874217338410368:12345-0@lo:103: 00010000:00010000:3.0:1787393017.500572:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393017.500576:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de8040d8600/0x19a927d9c62f1094 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f108d expref: 13 pid: 5813 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.500585:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de8040d8600/0x19a927d9c62f1094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f108d expref: 13 pid: 5813 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.500595:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393017.500616:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+13:3326:x1874217338410368:12345-0@lo:103: Request processed in 68us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393017.500623:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787393017.500656:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338410368:0@lo:103: 00000100:00100000:3.0:1787393017.500664:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338410240:0@lo:103: 00010000:00010000:0.0:1787393017.500959:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393017.500969:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83c92a300 going to sleep for 11 seconds 00010000:00010000:0.0:1787393017.500983:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de801531000/0x19a927d9c62f1104 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f10fd expref: 12 pid: 5815 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393017.500993:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5815:1874217338409856:0@lo:104: 00010000:00010000:0.0:1787393017.501002:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8040d8600/0x19a927d9c62f1094 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f108d expref: 11 pid: 5813 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393017.501019:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5815:1874217338409984:0@lo:104: 00000100:00100000:2.0:1787393017.504216:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338410112 00000100:00100000:2.0:1787393017.504231:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338410112 00000100:00100000:1.0:1787393017.504372:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787393017.504386:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:5815:x1874217338410112:12345-0@lo:104: 00010000:00010000:1.0:1787393017.504402:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1078 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.504503:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787393017.504510:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:5815:x1874217338410112:12345-0@lo:104: Request processed in 128us (4856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393017.504517:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787393017.504605:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5815:1874217338410112:0@lo:104: 00010000:00010000:0.0:1787393017.504635:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9de800031800/0x19a927d9c62f115f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.504684:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393017.504691:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1078 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.504698:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8029e3200 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1787393017.504702:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f1078 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.504710:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f1078 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787393017.504718:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f1078 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393017.504723:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787393017.504765:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1071 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1078 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.504785:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787393017.504818:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1071 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1078 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.504826:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1071 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1078 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.504874:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393017.504876:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393017.504878:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393017.504886:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787393017.504900:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338410496:0@lo:103: 00000100:00100000:3.0:1787393017.504940:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393017.504980:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338410496 00000100:00100000:3.0:1787393017.504984:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338410496 00010000:00010000:3.0:1787393017.505002:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de801531c00/0x19a927d9c62f1078 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1071 expref: 11 pid: 5813 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393017.505023:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787393017.505030:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+11:3325:x1874217338410496:12345-0@lo:103: 00010000:00010000:3.0:1787393017.505039:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393017.505044:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de801531c00/0x19a927d9c62f1078 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1071 expref: 11 pid: 5813 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.505053:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de801531c00/0x19a927d9c62f1078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f1071 expref: 11 pid: 5813 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.505067:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de801531c00/0x19a927d9c62f1078 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f1071 expref: 11 pid: 5813 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.505090:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9de800031800/0x19a927d9c62f115f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.505098:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de800031800/0x19a927d9c62f115f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.505121:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de800031800/0x19a927d9c62f115f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.505128:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de800031800/0x19a927d9c62f115f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.505134:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9de800031800/0x19a927d9c62f115f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.505140:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9de800031800/0x19a927d9c62f115f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.505145:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031800 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393017.505149:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9de800031800/0x19a927d9c62f115f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.505155:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9de800031800/0x19a927d9c62f115f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.505169:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9de800031800/0x19a927d9c62f115f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.505177:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393017.505206:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+10:3325:x1874217338410496:12345-0@lo:103: Request processed in 177us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393017.505222:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787393017.505255:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338410496:0@lo:103: 00010000:00010000:3.0:1787393017.505272:0:5815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9de800031800/0x19a927d9c62f115f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.505280:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9de800031800/0x19a927d9c62f115f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.505286:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de800031800/0x19a927d9c62f115f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787393017.505300:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787393017.554051:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+9:6620:x1874217338409728:12345-0@lo:253: Request processed in 61101us (61446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393017.554067:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787393017.554163:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338409728:0@lo:253: 10000000:01000000:1.0:1787393017.554178:0:6620:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787393017.554182:0:6620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787393017.554183:0:6620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787393017.554184:0:6620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787393017.554186:0:6620:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787393017.554187:0:6620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787393017.554189:0:6620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787393017.554190:0:6620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787393017.554192:0:6620:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787393017.554194:0:6620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787393017.554195:0:6620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787393017.554217:0:6620:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9de83d423000 from lustre-OST0000 10000000:01000000:1.0:1787393017.554316:0:6620:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787393017.554332:0:6620:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787393017.554338:0:6620:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9de8180e99c0 local copy 10000000:01000000:1.0:1787393017.554342:0:6620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787393017.554378:0:6620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f1166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.554389:0:6620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f1166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.554398:0:6620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f1166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393017.554417:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338410624:0@lo:101: 00000100:00100000:1.0:1787393017.554451:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393017.554552:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de820044780 going to sleep for 11 seconds 00000100:00100000:0.0:1787393017.554710:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338410624 00000100:00100000:0.0:1787393017.554716:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338410624 00000100:00100000:0.0:1787393017.554790:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787393017.554800:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+9:6620:x1874217338410624:12345-0@lo:101: 00010000:00010000:0.0:1787393017.554812:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393017.554826:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de800030000/0x19a927d9c62f116d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f1166 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393017.554909:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de800030000/0x19a927d9c62f116d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f1166 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393017.554920:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de800030000/0x19a927d9c62f116d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1166 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393017.554930:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800030000, rc 0) 00000100:00100000:0.0:1787393017.555088:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+10:6620:x1874217338410624:12345-0@lo:101: Request processed in 289us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393017.555095:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787393017.555200:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338410624:0@lo:101: 00010000:00010000:2.0:1787393017.555218:0:6620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f1166 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x19a927d9c62f116d expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.555227:0:6620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f1166 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x19a927d9c62f116d expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393017.555332:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338410752:0@lo:501: 00000100:00100000:2.0:1787393017.555361:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393017.555429:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de802f28d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787393017.555514:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338410752 00000100:00100000:0.0:1787393017.555527:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338410752 00000100:00100000:0.0:1787393017.555654:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787393017.555662:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+10:6620:x1874217338410752:12345-0@lo:501: 00000100:00100000:0.0:1787393017.555898:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+10:6620:x1874217338410752:12345-0@lo:501: Request processed in 236us (535us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787393017.555905:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787393017.555996:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338410752:0@lo:501: 10000000:01000000:2.0:1787393017.556012:0:6620:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787393017.556040:0:6620:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787393017.556046:0:6620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f1166 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x19a927d9c62f116d expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.556055:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f1166 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x19a927d9c62f116d expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.556063:0:6620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f1166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x19a927d9c62f116d expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.556081:0:6620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787393017.556096:0:6620:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9de83d423000 10000000:01000000:2.0:1787393017.556100:0:6620:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787393017.556104:0:6620:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9de8180e99c0 10000000:01000000:2.0:1787393017.556116:0:6620:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787393017.556125:0:6620:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9de8180e99c0 from 1 10000000:01000000:2.0:1787393017.556127:0:6620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787393017.556145:0:6620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e3e00/0x19a927d9c62f1174 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.556153:0:6620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8029e3e00/0x19a927d9c62f1174 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.556162:0:6620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8029e3e00/0x19a927d9c62f1174 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393017.556174:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338410880:0@lo:101: 00000100:00100000:2.0:1787393017.556198:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393017.556475:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de802f28480 going to sleep for 11 seconds 00000100:00100000:1.0:1787393017.556534:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338410880 00000100:00100000:1.0:1787393017.556539:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338410880 00000100:00100000:1.0:1787393017.556563:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787393017.556570:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+10:6620:x1874217338410880:12345-0@lo:101: 00010000:00010000:1.0:1787393017.556589:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393017.556601:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8040d8a00/0x19a927d9c62f117b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f1174 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.556618:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8040d8a00/0x19a927d9c62f117b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f1174 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.556628:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8040d8a00/0x19a927d9c62f117b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1174 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.556636:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d8a00, rc 0) 00000100:00100000:1.0:1787393017.556674:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+11:6620:x1874217338410880:12345-0@lo:101: Request processed in 104us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393017.556687:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787393017.556827:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338410880:0@lo:101: 00010000:00010000:2.0:1787393017.556854:0:6620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8029e3e00/0x19a927d9c62f1174 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f117b expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.556862:0:6620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8029e3e00/0x19a927d9c62f1174 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f117b expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393017.556879:0:6620:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787393017.556895:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e3e00/0x19a927d9c62f1174 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f117b expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.556903:0:6620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8029e3e00/0x19a927d9c62f1174 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f117b expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393017.556910:0:6620:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787393017.556914:0:6620:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787393017.556923:0:6620:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787393017.556925:0:6620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787393017.556940:0:6620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f1182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.556947:0:6620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f1182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.556954:0:6620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f1182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393017.556966:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338411008:0@lo:101: 00000100:00100000:2.0:1787393017.557003:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393017.557015:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de802f28480 going to sleep for 11 seconds 00000100:00100000:1.0:1787393017.557136:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338411008 00000100:00100000:1.0:1787393017.557140:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338411008 00000100:00100000:1.0:1787393017.557158:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787393017.557163:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+11:6620:x1874217338411008:12345-0@lo:101: 00010000:00010000:1.0:1787393017.557171:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393017.557178:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f1189 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f1182 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.557191:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f1189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f1182 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.557200:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f1189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1182 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.557207:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d9a00, rc 0) 00000100:00100000:1.0:1787393017.557312:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6620:x1874217338411008:12345-0@lo:101: Request processed in 148us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393017.557318:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787393017.557394:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338411008:0@lo:101: 00010000:00010000:2.0:1787393017.557403:0:6620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f1182 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1189 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.557411:0:6620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f1182 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f1189 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393017.557480:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338411136:0@lo:501: 00000100:00100000:2.0:1787393017.557503:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393017.557532:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de802f28480 going to sleep for 11 seconds 00000100:00100000:0.0:1787393017.557649:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338411136 00000100:00100000:0.0:1787393017.557654:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338411136 00000100:00100000:0.0:1787393017.557676:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787393017.557683:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6620:x1874217338411136:12345-0@lo:501: 00000100:00100000:0.0:1787393017.557902:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6620:x1874217338411136:12345-0@lo:501: Request processed in 218us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393017.557909:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1787393017.557932:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393017.557938:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f1166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x19a927d9c62f116d expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393017.557946:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8600 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1787393017.557950:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f1166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x19a927d9c62f116d expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393017.557958:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f1166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x19a927d9c62f116d expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787393017.557965:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f1166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x19a927d9c62f116d expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393017.557971:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787393017.558150:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338411136:0@lo:501: 00000100:00100000:2.0:1787393017.558179:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338411264:0@lo:503: 00000100:00100000:2.0:1787393017.558217:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787393017.558350:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f1166 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x19a927d9c62f116d expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393017.558363:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787393017.558384:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f1166 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x19a927d9c62f116d expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393017.558390:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f1166 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x19a927d9c62f116d expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393017.558401:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393017.558403:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393017.558405:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393017.558412:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787393017.558422:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338411392:0@lo:103: 00000100:00100000:0.0:1787393017.558449:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393017.558508:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de802f28480 going to sleep for 11 seconds 00000100:00100000:3.0:1787393017.558581:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338411264 00000100:00100000:3.0:1787393017.558587:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338411264 00000100:00100000:3.0:1787393017.558625:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787393017.558633:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6620:x1874217338411264:12345-0@lo:503: 00000100:00100000:3.0:1787393017.558788:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6620:x1874217338411264:12345-0@lo:503: Request processed in 156us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393017.558795:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787393017.558831:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338411392 00000100:00100000:3.0:1787393017.558834:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338411392 00000100:00100000:3.0:1787393017.558881:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787393017.558887:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+12:3324:x1874217338411392:12345-0@lo:103: 00010000:00010000:3.0:1787393017.558896:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393017.558911:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de800030000/0x19a927d9c62f116d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a927d9c62f1166 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.558922:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393017.558961:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+11:3324:x1874217338411392:12345-0@lo:103: Request processed in 73us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393017.558968:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787393017.559006:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338411392:0@lo:103: 00000100:00100000:2.0:1787393017.559147:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338411264:0@lo:503: 00000040:00080000:2.0:1787393017.559443:0:6620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787393017.559502:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338411520:0@lo:502: 00000100:00100000:2.0:1787393017.559539:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393017.559567:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de802f28480 going to sleep for 11 seconds 00000100:00100000:0.0:1787393017.559739:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338411520 00000100:00100000:0.0:1787393017.559744:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338411520 00000100:00100000:0.0:1787393017.559763:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787393017.559769:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+11:6620:x1874217338411520:12345-0@lo:502: 00000100:00100000:0.0:1787393017.559918:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+11:6620:x1874217338411520:12345-0@lo:502: Request processed in 148us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393017.559925:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787393017.560054:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338411520:0@lo:502: 00000040:00080000:2.0:1787393017.560353:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787393017.560397:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787393017.560430:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787393017.560474:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787393017.560511:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787393017.560542:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787393017.560564:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338411648:0@lo:502: 00000100:00100000:2.0:1787393017.560669:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393017.560700:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de802f28480 going to sleep for 11 seconds 00000100:00100000:0.0:1787393017.560754:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338411648 00000100:00100000:0.0:1787393017.560759:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338411648 00000100:00100000:0.0:1787393017.560791:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787393017.560798:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+11:6620:x1874217338411648:12345-0@lo:502: 00000100:00100000:0.0:1787393017.560972:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+11:6620:x1874217338411648:12345-0@lo:502: Request processed in 173us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393017.560979:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787393017.561062:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338411648:0@lo:502: 00000040:00080000:2.0:1787393017.561162:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787393017.561172:0:6620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1787393017.561950:0:6638:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787393017.561960:0:6638:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787393017.561966:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393017.561968:0:6638:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787393017.561974:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787393017.562934:0:6638:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9de83f800000) 00000020:00000080:2.0:1787393017.562962:0:6638:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787393017.562975:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787393017.563062:0:6638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9de83d423000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787393017.563069:0:6638:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787393017.563076:0:6638:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x19a927d9c62f1197 00010000:00010000:2.0:1787393017.568780:0:6638:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1787393017.569081:0:6638:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787393017.572084:0:6638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787393017.572445:0:6638:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787393017.580377:0:6638:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787393017.581200:0:6638:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787393017.582718:0:6638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787393017.582730:0:6638:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787393017.582737:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393017.582739:0:6638:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787393017.582742:0:6638:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787393017.582747:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393017.582748:0:6638:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787393017.582751:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787393017.582753:0:6638:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787393017.582800:0:6638:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787393017.582803:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393017.582805:0:6638:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787393017.582808:0:6638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787393017.583010:0:6620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787393017.583033:0:6620:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787393017.583056:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f1182 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1189 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.583067:0:6620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f1182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1189 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393017.583074:0:6620:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de83d423000 from 1 10000000:01000000:3.0:1787393017.583077:0:6620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787393017.583117:0:6620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de801531c00/0x19a927d9c62f119e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.583125:0:6620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de801531c00/0x19a927d9c62f119e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.583135:0:6620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de801531c00/0x19a927d9c62f119e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393017.583157:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338411776:0@lo:101: 00000100:00100000:3.0:1787393017.583229:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393017.583390:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8082b5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787393017.583390:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338411776 00000100:00100000:1.0:1787393017.583399:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338411776 00000100:00100000:1.0:1787393017.583452:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787393017.583463:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+11:6620:x1874217338411776:12345-0@lo:101: 00010000:00010000:1.0:1787393017.583476:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393017.583489:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8040d9e00/0x19a927d9c62f11a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f119e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.583603:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8040d9e00/0x19a927d9c62f11a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f119e expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.583749:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8040d9e00/0x19a927d9c62f11a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f119e expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.583758:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d9e00, rc 0) 00000100:00100000:1.0:1787393017.583809:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6620:x1874217338411776:12345-0@lo:101: Request processed in 349us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393017.583816:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787393017.584153:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338411776:0@lo:101: 00010000:00010000:3.0:1787393017.584179:0:6620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de801531c00/0x19a927d9c62f119e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f11a5 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.584201:0:6620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de801531c00/0x19a927d9c62f119e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f11a5 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393017.584432:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338411904:0@lo:501: 00000100:00100000:3.0:1787393017.584463:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393017.584492:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8082b5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787393017.584739:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338411904 00000100:00100000:1.0:1787393017.584744:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338411904 00000100:00100000:1.0:1787393017.584776:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787393017.584781:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6620:x1874217338411904:12345-0@lo:501: 00000100:00100000:1.0:1787393017.585037:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6620:x1874217338411904:12345-0@lo:501: Request processed in 255us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393017.585045:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787393017.585490:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338411904:0@lo:501: 00000100:00100000:3.0:1787393017.585527:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338412032:0@lo:503: 00000100:00100000:3.0:1787393017.585585:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393017.585614:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8082b5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787393017.585889:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338412032 00000100:00100000:1.0:1787393017.585895:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338412032 00000100:00100000:1.0:1787393017.585934:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787393017.585942:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6620:x1874217338412032:12345-0@lo:503: 00000100:00100000:1.0:1787393017.586502:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6620:x1874217338412032:12345-0@lo:503: Request processed in 559us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393017.586510:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787393017.586631:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338412032:0@lo:503: 00000040:00080000:3.0:1787393017.586930:0:6620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787393017.587002:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338412160:0@lo:502: 00000100:00100000:3.0:1787393017.587045:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393017.587067:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8082b5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787393017.587206:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338412160 00000100:00100000:1.0:1787393017.587211:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338412160 00000100:00100000:1.0:1787393017.587257:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787393017.587266:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6620:x1874217338412160:12345-0@lo:502: 00000100:00100000:1.0:1787393017.587428:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6620:x1874217338412160:12345-0@lo:502: Request processed in 162us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393017.587443:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787393017.587887:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338412160:0@lo:502: 00000040:00080000:3.0:1787393017.588158:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787393017.588217:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787393017.588399:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338412288:0@lo:502: 00000100:00100000:3.0:1787393017.588444:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393017.588476:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338412288 00000100:00100000:3.0:1787393017.588481:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338412288 00000100:00100000:3.0:1787393017.588509:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787393017.588516:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6620:x1874217338412288:12345-0@lo:502: 00000100:00100000:3.0:1787393017.588936:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6620:x1874217338412288:12345-0@lo:502: Request processed in 418us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393017.588944:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787393017.588987:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8082b5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787393017.589005:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338412288:0@lo:502: 00000040:00080000:3.0:1787393017.589093:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787393017.589104:0:6620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787393017.589926:0:6641:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787393017.589938:0:6641:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393017.589940:0:6641:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787393017.589946:0:6641:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9de83d423000 00000020:00000080:0.0:1787393017.589949:0:6641:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787393017.589968:0:6641:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787393017.589971:0:6641:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393017.589972:0:6641:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787393017.589975:0:6641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787393017.590113:0:6620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787393017.590135:0:6620:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787393017.590156:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de801531c00/0x19a927d9c62f119e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f11a5 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.590176:0:6620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de801531c00/0x19a927d9c62f119e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f11a5 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393017.590216:0:6620:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787393017.590219:0:6620:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9de83d423000 10000000:01000000:1.0:1787393017.590223:0:6620:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9de83d423000 10000000:01000000:1.0:1787393017.590227:0:6620:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787393017.590233:0:6620:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9de83d423000 from 1 10000000:01000000:1.0:1787393017.590385:0:6620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787393017.590418:0:6620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f11ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.590426:0:6620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f11ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.590436:0:6620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f11ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393017.590452:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338412416:0@lo:101: 00000100:00100000:1.0:1787393017.590496:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393017.590533:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808038480 going to sleep for 11 seconds 00000100:00100000:3.0:1787393017.590598:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338412416 00000100:00100000:3.0:1787393017.590605:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338412416 00000100:00100000:3.0:1787393017.590647:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787393017.590655:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6620:x1874217338412416:12345-0@lo:101: 00010000:00010000:3.0:1787393017.590667:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393017.590678:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de801530400/0x19a927d9c62f11b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f11ac expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.590698:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de801530400/0x19a927d9c62f11b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f11ac expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.590707:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de801530400/0x19a927d9c62f11b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f11ac expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393017.590715:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530400, rc 0) 00000100:00100000:3.0:1787393017.590756:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+13:6620:x1874217338412416:12345-0@lo:101: Request processed in 102us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393017.590762:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787393017.590922:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338412416:0@lo:101: 00010000:00010000:0.0:1787393017.590935:0:6620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f11ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f11b3 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393017.590944:0:6620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f11ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f11b3 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393017.591039:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338412544:0@lo:501: 00000100:00100000:0.0:1787393017.591065:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393017.591079:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83c92a540 going to sleep for 11 seconds 00000100:00100000:1.0:1787393017.591142:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338412544 00000100:00100000:1.0:1787393017.591147:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338412544 00000100:00100000:1.0:1787393017.591192:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787393017.591199:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:6620:x1874217338412544:12345-0@lo:501: 00000100:00100000:1.0:1787393017.591666:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:6620:x1874217338412544:12345-0@lo:501: Request processed in 465us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393017.591674:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787393017.591795:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338412544:0@lo:501: 00000100:00100000:0.0:1787393017.591824:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338412672:0@lo:503: 00000100:00100000:0.0:1787393017.591879:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393017.591946:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83c92a540 going to sleep for 11 seconds 00000100:00100000:3.0:1787393017.592013:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338412672 00000100:00100000:3.0:1787393017.592018:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338412672 00000100:00100000:3.0:1787393017.592087:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787393017.592102:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+13:6620:x1874217338412672:12345-0@lo:503: 00000100:00100000:3.0:1787393017.592421:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+13:6620:x1874217338412672:12345-0@lo:503: Request processed in 319us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393017.592428:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787393017.592495:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338412672:0@lo:503: 00000040:00080000:0.0:1787393017.592765:0:6620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787393017.592872:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338412800:0@lo:502: 00000100:00100000:0.0:1787393017.592918:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393017.593149:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83c92a540 going to sleep for 11 seconds 00000100:00100000:1.0:1787393017.593309:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338412800 00000100:00100000:1.0:1787393017.593315:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338412800 00000100:00100000:1.0:1787393017.593347:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787393017.593356:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:6620:x1874217338412800:12345-0@lo:502: 00000100:00100000:1.0:1787393017.593544:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:6620:x1874217338412800:12345-0@lo:502: Request processed in 189us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393017.593552:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787393017.593670:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338412800:0@lo:502: 00000040:00080000:0.0:1787393017.593991:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787393017.594046:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787393017.594078:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787393017.594138:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787393017.594193:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787393017.594275:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787393017.594320:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787393017.594371:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787393017.594438:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787393017.594478:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787393017.594517:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787393017.594568:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787393017.594748:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787393017.594814:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787393017.594902:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787393017.594960:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787393017.595004:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787393017.595073:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787393017.595129:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787393017.595166:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787393017.595373:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787393017.595436:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787393017.595478:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787393017.595536:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787393017.595640:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787393017.595702:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787393017.595776:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787393017.595818:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1787393017.595885:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338412928:0@lo:502: 00000100:00100000:0.0:1787393017.595954:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393017.595995:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83c92a540 going to sleep for 11 seconds 00000100:00100000:1.0:1787393017.596085:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338412928 00000100:00100000:1.0:1787393017.596092:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338412928 00000100:00100000:1.0:1787393017.596140:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787393017.596148:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:6620:x1874217338412928:12345-0@lo:502: 00000100:00100000:1.0:1787393017.596399:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:6620:x1874217338412928:12345-0@lo:502: Request processed in 250us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393017.596407:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787393017.596694:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338412928:0@lo:502: 00000040:00080000:0.0:1787393017.596777:0:6620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787393017.596789:0:6620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787393017.597712:0:6643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787393017.597726:0:6643:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9de8180ecd40) 00000020:00000080:0.0:1787393017.597754:0:6643:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787393017.597987:0:6643:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9de83d423000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787393017.597991:0:6643:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9de83d423000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787393017.597994:0:6643:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9de83d423000 3 00010000:00080000:0.0:1787393017.598020:0:6643:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9de83facc800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.121@tcp at head 00010000:00010000:0.0:1787393017.601302:0:6643:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1787393017.601411:0:6643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787393017.601450:0:6643:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787393017.601462:0:6643:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x19a927d9c62f11c1 00000100:00080000:0.0:1787393017.601472:0:6643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787393017.601478:0:6643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9de83facc800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:0.0:1787393017.601512:0:6643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de83c63f100 x1874217338413056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787393017.601543:0:6643:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787393017.601697:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3323:1874217338413056:0@lo:38: 00000100:00100000:1.0:1787393017.601767:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393017.601868:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338413056 00000100:00100000:1.0:1787393017.601876:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338413056 00000100:00100000:1.0:1787393017.601912:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787393017.601918:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3323:x1874217338413056:12345-0@lo:38: 00010000:00080000:1.0:1787393017.601939:0:5822:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:1.0:1787393017.601972:0:5822:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x19a927d9c62f11c8 00000004:00100000:1.0:1787393017.601995:0:5822:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787393017.602028:0:5822:0:(import.c:65:import_set_state_nolock()) ffff9de834e09800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787393017.602080:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1874217338413056:12345-0@lo:38: Request processed in 160us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393017.602087:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787393017.602134:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9de83c63f100 x1874217338413056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787393027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393017.602144:0:3323:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787393017.602150:0:3323:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787393017.602157:0:3323:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787393017.602161:0:3323:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787393017.602163:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de83facc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787393017.602370:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3323:1874217338413056:0@lo:38: 00000100:00100000:2.0:1787393017.605997:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787393017.606017:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338413184:0@lo:400: 00000100:00100000:2.0:1787393017.606082:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787393017.606104:0:6643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1787393017.606163:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338413184 00000100:00100000:2.0:1787393017.606171:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338413184 00000020:01000000:1.0:1787393017.606214:0:6620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 00000100:00100000:2.0:1787393017.606231:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787393017.606242:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338413184:12345-0@lo:400: 10000000:01000000:1.0:1787393017.606355:0:6620:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787393017.606374:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f11ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f11b3 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.606386:0:6620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f11ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f11b3 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393017.606398:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338413184:12345-0@lo:400: Request processed in 156us (315us total) trans 0 rc 0/0 00010000:00080000:3.0:1787393017.606433:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9de810337800 x1874217338413184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000004:1.0:1787393017.606444:0:6620:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000100:00100000:3.0:1787393017.606447:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338413184:0@lo:400: 00000020:01000004:1.0:1787393017.606447:0:6620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787393017.606448:0:6620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787393017.606449:0:6620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787393017.606451:0:6620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787393017.606452:0:6620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787393017.606453:0:6620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787393017.606458:0:6620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787393017.606459:0:6620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787393017.606461:0:6620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787393017.606462:0:6620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787393017.606466:0:6620:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787393017.606468:0:6620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787393017.606469:0:6620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787393017.606470:0:6620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787393017.606470:0:6620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787393017.606471:0:6620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787393017.606473:0:6620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787393017.606474:0:6620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787393017.606474:0:6620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787393017.606475:0:6620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787393017.606476:0:6620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787393017.606477:0:6620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787393017.606492:0:6620:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787393017.606502:0:6620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338413312:0@lo:253: 00000100:00100000:2.0:1787393017.606522:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787393017.606539:0:6620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393017.606568:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338413312 00000100:00100000:1.0:1787393017.606583:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338413312 00000100:00100000:1.0:1787393017.606614:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787393017.606620:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:6620:x1874217338413312:12345-0@lo:253: 20000000:01000000:1.0:1787393017.606637:0:5813:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787393017.606649:0:5813:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787393017.607160:0:6620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818157180 going to sleep for 11 seconds 20000000:01000000:3.0:1787393017.637378:0:5813:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787393017.637397:0:5813:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787393017.637456:0:5836:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787393017.637462:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787393017.637495:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f11cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.637513:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de800030c00/0x19a927d9c62f1127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1120 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.637522:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f11cf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.637564:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de800030c00/0x19a927d9c62f1127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f1120 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.637728:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de800030c00/0x19a927d9c62f1127 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f1120 expref: 13 pid: 5813 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393017.637743:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5836:1874217338413440:0@lo:104: 00000100:00100000:2.0:1787393017.637803:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393017.637942:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de802f28e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787393017.637963:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338413440 00000100:00100000:2.0:1787393017.637969:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338413440 00000100:00100000:2.0:1787393017.638019:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787393017.638038:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810336a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:5836:x1874217338413440:12345-0@lo:104: 00010000:00010000:2.0:1787393017.638050:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f1120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1127 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638119:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787393017.638126:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810336a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:5836:x1874217338413440:12345-0@lo:104: Request processed in 90us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393017.638132:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787393017.638152:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787393017.638165:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f1120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1127 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638173:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8200 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1787393017.638176:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f1120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f1127 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638184:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f1120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f1127 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787393017.638191:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f1120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f1127 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393017.638197:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787393017.638225:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f1120 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1127 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638232:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787393017.638248:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f1120 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1127 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638255:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f1120 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1127 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638271:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393017.638273:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393017.638274:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393017.638292:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338413568:0@lo:103: 00000100:00100000:2.0:1787393017.638325:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393017.638365:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338413568 00000100:00100000:2.0:1787393017.638370:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338413568 00000100:00100000:1.0:1787393017.638388:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5836:1874217338413440:0@lo:104: 00010000:00010000:1.0:1787393017.638411:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f11cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638635:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de800030c00/0x19a927d9c62f1127 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1120 expref: 14 pid: 5813 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393017.638664:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787393017.638671:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de826cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+14:3327:x1874217338413568:12345-0@lo:103: 00010000:00010000:2.0:1787393017.638680:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393017.638685:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de800030c00/0x19a927d9c62f1127 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1120 expref: 14 pid: 5813 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638695:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de800030c00/0x19a927d9c62f1127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f1120 expref: 14 pid: 5813 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638708:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de800030c00/0x19a927d9c62f1127 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f1120 expref: 14 pid: 5813 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638720:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f11cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638728:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f11cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787393017.638740:0:5805:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001604933s 00010000:00010000:2.0:1787393017.638744:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f11cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638752:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f11cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638758:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f11cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638764:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f11cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638776:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8029e3000 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393017.638780:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f11cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638788:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f11cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638807:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f11cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393017.638817:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393017.638885:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de826cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:3327:x1874217338413568:12345-0@lo:103: Request processed in 214us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393017.638891:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787393017.639185:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f11cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.639194:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f11cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393017.639207:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f11cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393017.639583:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338413568:0@lo:103: 00000100:00100000:0.0:1787393017.643961:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:6620:x1874217338413312:12345-0@lo:253: Request processed in 37332us (37414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393017.643976:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787393017.644156:0:6620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:6620:1874217338413312:0@lo:253: 10000000:01000000:2.0:1787393017.644170:0:6620:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787393017.644173:0:6620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787393017.644175:0:6620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787393017.644176:0:6620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787393017.644177:0:6620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787393017.644179:0:6620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787393017.644180:0:6620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787393017.644181:0:6620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787393017.644183:0:6620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787393017.644184:0:6620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787393017.644186:0:6620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787393017.644187:0:6620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787393017.644202:0:6620:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787393017.652193:0:6620:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787393017.652548:0:6620:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787393017.652833:0:6620:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787393017.656180:0:6620:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787393017.657367:0:6620:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787393017.657651:0:6620:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787393017.659466:0:6620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787393017.882402:0:6620:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787393017.882408:0:6620:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787393017.882438:0:6620:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787393017.882494:0:6620:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.121@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787393017.882508:0:6620:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787393017.882533:0:6620:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787393018.345799:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393019.369130:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787393019.879946:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787393019.879954:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9de804ca6000 from 21 10000000:01000000:2.0:1787393019.879958:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787393019.880001:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2a00/0x19a927d9c62f11d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393019.880011:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8029e2a00/0x19a927d9c62f11d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393019.880021:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8029e2a00/0x19a927d9c62f11d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393019.880044:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338413696:0@lo:101: 00000100:00100000:2.0:1787393019.880125:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393019.880260:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338413696 00000100:00100000:3.0:1787393019.880269:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338413696 00000100:00100000:3.0:1787393019.880313:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787393019.880332:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5818:x1874217338413696:12345-0@lo:101: 00010000:00010000:3.0:1787393019.880344:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393019.880355:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de801530600/0x19a927d9c62f11dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f11d6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393019.880377:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de801530600/0x19a927d9c62f11dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f11d6 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393019.880387:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de801530600/0x19a927d9c62f11dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f11d6 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393019.880395:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530600, rc 0) 00000100:00100000:3.0:1787393019.880428:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+13:5818:x1874217338413696:12345-0@lo:101: Request processed in 108us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393019.880451:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787393019.880664:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de807783180 going to sleep for 11 seconds 00000100:00100000:2.0:1787393019.880687:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338413696:0@lo:101: 00010000:00010000:2.0:1787393019.880700:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8029e2a00/0x19a927d9c62f11d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f11dd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393019.880708:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8029e2a00/0x19a927d9c62f11d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f11dd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393019.880770:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338413824:0@lo:501: 00000100:00100000:2.0:1787393019.880796:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393019.880813:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de807783180 going to sleep for 11 seconds 00000100:00100000:3.0:1787393019.881236:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338413824 00000100:00100000:3.0:1787393019.881241:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338413824 00000100:00100000:3.0:1787393019.881273:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787393019.881280:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:5818:x1874217338413824:12345-0@lo:501: 00000100:00100000:3.0:1787393019.881636:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:5818:x1874217338413824:12345-0@lo:501: Request processed in 355us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393019.881652:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787393019.881894:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338413824:0@lo:501: 00000100:00100000:2.0:1787393019.881921:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338413952:0@lo:503: 00000100:00100000:2.0:1787393019.881952:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393019.881980:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de807783180 going to sleep for 11 seconds 00000100:00100000:3.0:1787393019.882064:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338413952 00000100:00100000:3.0:1787393019.882069:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338413952 00000100:00100000:3.0:1787393019.882106:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787393019.882113:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:5818:x1874217338413952:12345-0@lo:503: 00000100:00100000:3.0:1787393019.882599:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:5818:x1874217338413952:12345-0@lo:503: Request processed in 485us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393019.882606:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787393019.882750:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338413952:0@lo:503: 00000100:00100000:1.0:1787393019.883085:0:6766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:6766:1874217338414080:0@lo:502: 00000100:00100000:1.0:1787393019.883128:0:6766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393019.883185:0:6766:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818736d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787393019.883266:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338414080 00000100:00100000:3.0:1787393019.883270:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338414080 00000100:00100000:3.0:1787393019.883379:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787393019.883386:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+13:6766:x1874217338414080:12345-0@lo:502: 00000100:00100000:3.0:1787393019.883637:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+13:6766:x1874217338414080:12345-0@lo:502: Request processed in 251us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393019.883651:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787393019.883818:0:6766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:6766:1874217338414080:0@lo:502: 00000100:00100000:1.0:1787393019.883892:0:6766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:6766:1874217338414208:0@lo:502: 00000100:00100000:1.0:1787393019.883924:0:6766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393019.883944:0:6766:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818736d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787393019.883994:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338414208 00000100:00100000:0.0:1787393019.883999:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338414208 00000100:00100000:0.0:1787393019.884033:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787393019.884041:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:6766:x1874217338414208:12345-0@lo:502: 00000100:00100000:0.0:1787393019.884330:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:6766:x1874217338414208:12345-0@lo:502: Request processed in 280us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393019.884337:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787393019.884535:0:6766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:6766:1874217338414208:0@lo:502: 00000040:00080000:2.0:1787393019.884556:0:6766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787393019.884827:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787393019.885003:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787393019.885014:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2a00/0x19a927d9c62f11d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f11dd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393019.885025:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8029e2a00/0x19a927d9c62f11d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f11dd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393019.885034:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787393019.885037:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9de804ca6000 from 4 10000000:01000000:0.0:1787393019.885040:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787393019.885068:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f11e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393019.885076:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f11e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393019.885083:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f11e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393019.885106:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338414336:0@lo:101: 00000100:00100000:0.0:1787393019.885139:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393019.885217:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de81a9366c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787393019.885305:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338414336 00000100:00100000:3.0:1787393019.885310:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338414336 00000100:00100000:3.0:1787393019.886856:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787393019.886869:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:5818:x1874217338414336:12345-0@lo:101: 00010000:00010000:3.0:1787393019.886899:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393019.886918:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de801531600/0x19a927d9c62f11eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f11e4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393019.886944:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de801531600/0x19a927d9c62f11eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f11e4 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393019.886955:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de801531600/0x19a927d9c62f11eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f11e4 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393019.886964:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531600, rc 0) 00000100:00100000:3.0:1787393019.887028:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+14:5818:x1874217338414336:12345-0@lo:101: Request processed in 162us (1888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393019.887035:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787393019.887274:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338414336:0@lo:101: 00010000:00010000:0.0:1787393019.887290:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f11e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f11eb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393019.887311:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f11e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f11eb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393019.887383:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338414464:0@lo:256: 00000100:00100000:0.0:1787393019.887418:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393019.887452:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de81a9366c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787393019.887764:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338414464 00000100:00100000:3.0:1787393019.887772:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338414464 00000100:00100000:3.0:1787393019.887810:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787393019.887817:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+14:5818:x1874217338414464:12345-0@lo:256: 20000000:01000000:3.0:1787393019.887832:0:5815:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787393019.887884:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787393019.887887:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787393019.887966:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+14:5818:x1874217338414464:12345-0@lo:256: Request processed in 149us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393019.887974:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787393019.888088:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338414464:0@lo:256: 10000000:01000000:2.0:1787393019.888158:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787393019.888165:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f11e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f11eb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393019.888173:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f11e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f11eb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393019.888180:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787393019.888182:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787393019.888185:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787393019.888217:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f11f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393019.888224:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f11f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393019.888239:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f11f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393019.888253:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338414592:0@lo:101: 00000100:00100000:2.0:1787393019.888280:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393019.888306:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de807783180 going to sleep for 11 seconds 00000100:00100000:1.0:1787393019.888359:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338414592 00000100:00100000:1.0:1787393019.888363:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338414592 00000100:00100000:1.0:1787393019.888393:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787393019.888400:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:5818:x1874217338414592:12345-0@lo:101: 00010000:00010000:1.0:1787393019.888408:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393019.888420:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8040d8000/0x19a927d9c62f11f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f11f2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393019.888436:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8040d8000/0x19a927d9c62f11f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f11f2 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393019.888445:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8040d8000/0x19a927d9c62f11f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f11f2 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393019.888452:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d8000, rc 0) 00000100:00100000:1.0:1787393019.888489:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338414592:12345-0@lo:101: Request processed in 89us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393019.888501:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787393019.888770:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338414592:0@lo:101: 00010000:00010000:2.0:1787393019.888781:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f11f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f11f9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393019.888789:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f11f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f11f9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393019.888834:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338414720:0@lo:501: 00000100:00100000:2.0:1787393019.888894:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393019.888911:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de807783180 going to sleep for 11 seconds 00000100:00100000:1.0:1787393019.888972:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338414720 00000100:00100000:1.0:1787393019.888977:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338414720 00000100:00100000:1.0:1787393019.889007:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787393019.889014:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338414720:12345-0@lo:501: 00000100:00100000:1.0:1787393019.889269:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338414720:12345-0@lo:501: Request processed in 255us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393019.889277:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787393019.889308:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338414720:0@lo:501: 00000100:00100000:1.0:1787393019.889343:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338414848:0@lo:503: 00000100:00100000:1.0:1787393019.889379:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393019.889393:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818736a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787393019.889403:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338414848 00000100:00100000:1.0:1787393019.889406:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338414848 00000100:00100000:1.0:1787393019.889422:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787393019.889427:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338414848:12345-0@lo:503: 00000100:00100000:1.0:1787393019.889806:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338414848:12345-0@lo:503: Request processed in 377us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393019.889814:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787393019.889878:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338414848:0@lo:503: 00000100:00100000:1.0:1787393019.890072:0:6767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:6767:1874217338414976:0@lo:502: 00000100:00100000:1.0:1787393019.890114:0:6767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393019.890132:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338414976 00000100:00100000:1.0:1787393019.890136:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338414976 00000100:00100000:1.0:1787393019.890154:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787393019.890171:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+15:6767:x1874217338414976:12345-0@lo:502: 00000100:00100000:1.0:1787393019.890363:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+15:6767:x1874217338414976:12345-0@lo:502: Request processed in 194us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393019.890370:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787393019.890399:0:6767:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83c61d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393019.890410:0:6767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:6767:1874217338414976:0@lo:502: 00000020:01000000:1.0:1787393019.890431:0:6767:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787393019.890438:0:6767:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787393019.890444:0:6767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393019.890446:0:6767:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787393019.890454:0:6767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787393019.890457:0:6767:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.121@tcp to nid 0x20000c0a8cb79 (192.168.203.121@tcp) 00000020:01000000:1.0:1787393019.890477:0:6767:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787393019.890479:0:6767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787393019.890502:0:6767:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9de81808cd40) 00000020:00000080:1.0:1787393019.890522:0:6767:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787393019.890528:0:6767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787393019.890586:0:6767:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787393019.890591:0:6767:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787393019.890598:0:6767:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a927d9c62f1207 00010000:00080000:1.0:1787393019.890633:0:6767:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9de834cc3800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.121@tcp at head 00010000:00010000:1.0:1787393019.891493:0:6767:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787393019.959796:0:6767:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787393019.959821:0:6767:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787393019.960639:0:6767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787393019.960912:0:6767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787393019.960961:0:6767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787393019.961010:0:6767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787393019.962070:0:6769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787393019.962077:0:6769:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787393019.963026:0:6767:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787393019.963038:0:6767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787393019.963071:0:6767:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787393019.963102:0:6767:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a927d9c62f120e 00000100:00080000:0.0:1787393019.963112:0:6767:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787393019.963118:0:6767:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9de834cc3800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:0.0:1787393019.963153:0:6767:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de83c63d500 x1874217338415104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787393019.963174:0:6767:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1787393019.963355:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338415232:0@lo:400: 00000100:00100000:3.0:1787393019.963417:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393019.963483:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787393019.963488:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338415232 00000100:00100000:3.0:1787393019.963492:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338415360:0@lo:400: 00000100:00100000:2.0:1787393019.963496:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338415232 00000100:00100000:3.0:1787393019.963532:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393019.963995:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338415104:0@lo:8: 00000100:00100000:1.0:1787393019.964036:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787393019.964183:0:6767:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787393019.964188:0:6767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393019.964191:0:6767:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787393019.964194:0:6767:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787393019.964197:0:6767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393019.964209:0:6767:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787393019.964214:0:6767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787393019.964215:0:6767:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787393019.964238:0:6767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:6767:1874217338415488:0@lo:502: 00000100:00100000:0.0:1787393019.964287:0:6767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393019.964310:0:6767:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8082b1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787393019.964337:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338415104 00000100:00100000:0.0:1787393019.964345:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338415104 00000100:00100000:0.0:1787393019.964369:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787393019.964375:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3323:x1874217338415104:12345-0@lo:8: 00010000:00080000:0.0:1787393019.964395:0:6622:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:0.0:1787393019.964418:0:6622:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a927d9c62f1215 00002000:00100000:0.0:1787393019.964447:0:6622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9de83fac8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787393019.964452:0:6622:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787393019.964455:0:6622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787393019.964562:0:6622:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787393019.964823:0:6622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787393019.964870:0:6622:0:(import.c:65:import_set_state_nolock()) ffff9de83fac8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787393019.964922:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3323:x1874217338415104:12345-0@lo:8: Request processed in 545us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393019.964931:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787393019.964974:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de83c63d500 x1874217338415104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787393029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393019.964984:0:3323:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787393019.964991:0:3323:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787393019.964998:0:3323:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787393019.965002:0:3323:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787393019.965005:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de834cc3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787393019.965018:0:3323:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787393019.965024:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338415104:0@lo:8: 00000100:00100000:1.0:1787393019.965283:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338415488 00000100:00100000:1.0:1787393019.965289:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338415488 00000100:00100000:1.0:1787393019.965341:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787393019.965350:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+15:6767:x1874217338415488:12345-0@lo:502: 00000100:00100000:1.0:1787393019.965554:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+15:6767:x1874217338415488:12345-0@lo:502: Request processed in 206us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393019.965561:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787393019.965883:0:6767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:6767:1874217338415488:0@lo:502: 00000020:01000000:0.0:1787393019.965909:0:6767:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787393019.965915:0:6767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393019.965922:0:6767:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787393019.965929:0:6767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:2.0:1787393019.966116:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338415360 00000100:00100000:2.0:1787393019.966130:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338415360 00000100:00100000:2.0:1787393019.966180:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787393019.966189:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338415232:12345-0@lo:400: 00000100:00100000:2.0:1787393019.966257:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338415232:12345-0@lo:400: Request processed in 70us (2840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393019.966263:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787393019.966286:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787393019.966292:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338415360:12345-0@lo:400: 00000100:00100000:2.0:1787393019.966340:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338415360:12345-0@lo:400: Request processed in 48us (2808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393019.966347:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000000:1.0:1787393019.966438:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787393019.966456:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787393019.966465:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f11f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f11f9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393019.966477:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f11f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f11f9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393019.966486:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787393019.966489:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9de8180e99c0 from 1 10000000:01000000:1.0:1787393019.966492:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787393019.966520:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8800/0x19a927d9c62f121c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393019.966529:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8040d8800/0x19a927d9c62f121c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393019.966537:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8040d8800/0x19a927d9c62f121c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393019.966553:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338415616:0@lo:101: 00000100:00100000:1.0:1787393019.966595:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393019.966752:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83c92ad80 going to sleep for 11 seconds 00000100:00080000:3.0:1787393019.966866:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787393019.966897:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de810337480 x1874217338415360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393019.966910:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338415360:0@lo:400: 00010000:00080000:3.0:1787393019.966923:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de810336d80 x1874217338415232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393019.966933:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338415232:0@lo:400: 00000004:00080000:3.0:1787393019.967084:0:6769:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787393019.967175:0:6769:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 169142335601ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787393019.972016:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338415616 00000100:00100000:0.0:1787393019.972030:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338415616 00000100:00100000:0.0:1787393019.972077:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787393019.972086:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338415616:12345-0@lo:101: 00010000:00010000:0.0:1787393019.972113:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393019.972132:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de800031a00/0x19a927d9c62f1223 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f121c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393019.972157:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de800031a00/0x19a927d9c62f1223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f121c expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393019.972169:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de800031a00/0x19a927d9c62f1223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f121c expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393019.972178:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800031a00, rc 0) 00000100:00100000:0.0:1787393019.973438:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338415616:12345-0@lo:101: Request processed in 1346us (6835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393019.973449:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787393019.973537:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338415616:0@lo:101: 00010000:00010000:1.0:1787393019.973560:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8040d8800/0x19a927d9c62f121c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1223 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393019.973575:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8800/0x19a927d9c62f121c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f1223 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393019.974125:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338415744:0@lo:501: 00000100:00100000:1.0:1787393019.974169:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393019.975575:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83c92ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787393019.976612:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338415744 00000100:00100000:2.0:1787393019.976623:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338415744 00000100:00100000:2.0:1787393019.976683:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787393019.976693:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338415744:12345-0@lo:501: 00000100:00100000:2.0:1787393019.977012:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338415744:12345-0@lo:501: Request processed in 319us (2841us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787393019.977022:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787393019.977035:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338415744:0@lo:501: 10000000:01000000:0.0:1787393019.977087:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787393019.977106:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8800/0x19a927d9c62f121c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1223 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393019.977118:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8040d8800/0x19a927d9c62f121c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1223 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787393020.013637:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787393020.013825:0:6770:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787393020.013881:0:6770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6770:1874217338416000:0@lo:7: 00000100:00100000:3.0:1787393020.013969:0:6770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393020.014017:0:6770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978600 going to sleep for 11 seconds 00000100:00100000:0.0:1787393020.014019:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338416000 00000100:00100000:0.0:1787393020.014033:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338416000 00000100:00100000:3.0:1787393020.014037:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787393020.014049:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338415872:0@lo:13: 00000100:00100000:3.0:1787393020.014080:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393020.014467:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338415872 00000100:00100000:1.0:1787393020.014473:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338415872 00000100:00100000:1.0:1787393020.014544:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787393020.014554:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3327:x1874217338415872:12345-0@lo:13: 00002000:00000024:1.0:1787393020.014586:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787393020.014650:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3327:x1874217338415872:12345-0@lo:13: Request processed in 89us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393020.014659:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787393020.014692:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787393020.014704:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835329500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6770:x1874217338416000:12345-0@lo:7: 00010000:00080000:3.0:1787393020.014778:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de83532a680 x1874217338415872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393020.014797:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338415872:0@lo:13: 00000100:00080000:3.0:1787393020.014907:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1787393020.027983:0:6625:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787393020.027992:0:6625:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787393020.028108:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835329500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6770:x1874217338416000:12345-0@lo:7: Request processed in 13389us (14123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393020.028120:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787393020.028147:0:6770:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de835328700 x1874217338416000/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787393036 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393020.028164:0:6770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6770:1874217338416000:0@lo:7: 00000004:00080000:3.0:1787393020.028186:0:6770:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787393020.028240:0:6770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6770:1874217338416128:0@lo:5: 00000100:00100000:3.0:1787393020.028508:0:6770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393020.028543:0:6770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978600 going to sleep for 11 seconds 00000100:00100000:0.0:1787393020.028690:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338416128 00000100:00100000:0.0:1787393020.028697:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338416128 00000100:00100000:0.0:1787393020.028745:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787393020.028755:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6770:x1874217338416128:12345-0@lo:5: 00002000:00080000:0.0:1787393020.028782:0:6624:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787393020.028786:0:6624:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787393020.029146:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6770:x1874217338416128:12345-0@lo:5: Request processed in 391us (636us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787393020.029155:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787393020.029196:0:6770:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de835328700 x1874217338416128/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787393036 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393020.029211:0:6770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6770:1874217338416128:0@lo:5: 00000004:00080000:0.0:1787393020.029222:0:6770:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787393020.029248:0:6770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6770:1874217338416256:0@lo:700: 00000100:00100000:0.0:1787393020.029273:0:6770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393020.029289:0:6770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8082b10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787393020.029308:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338416256 00000100:00100000:0.0:1787393020.029311:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338416256 00000100:00100000:0.0:1787393020.029342:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787393020.029351:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6770:x1874217338416256:12345-0@lo:700: 00000100:00100000:0.0:1787393020.029389:0:6631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6631:1874217338416384:0@lo:700: 00000100:00100000:0.0:1787393020.029430:0:6631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393020.029456:0:6631:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8082b1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787393020.029517:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338416384 00000100:00100000:1.0:1787393020.029522:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338416384 00000100:00100000:1.0:1787393020.029559:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787393020.029566:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6631:x1874217338416384:12345-0@lo:700: 40000000:02000000:1.0:1787393020.073015:0:5827:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787393020.086639:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6631:x1874217338416384:12345-0@lo:700: Request processed in 57062us (57196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393020.086659:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787393020.086772:0:6631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de83c63ce00 x1874217338416384/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787393036 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393020.086788:0:6631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6631:1874217338416384:0@lo:700: 40000000:02000000:0.0:1787393020.086801:0:6631:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1787393020.175144:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6770:x1874217338416256:12345-0@lo:700: Request processed in 145471us (145546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393020.175165:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:3.0:1787393020.175235:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1787393020.175245:0:6648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1787393020.175420:0:6770:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de83c63f800 x1874217338416256/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787393036 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393020.175453:0:6770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6770:1874217338416256:0@lo:700: 00000004:02000040:3.0:1787393020.204826:0:6770:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787393020.209368:0:6770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6770:1874217338416512:0@lo:5: 00000100:00100000:3.0:1787393020.209434:0:6770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393020.209497:0:6770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808f73780 going to sleep for 11 seconds 00000100:00100000:1.0:1787393020.209586:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338416512 00000100:00100000:1.0:1787393020.209594:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338416512 00000100:00100000:1.0:1787393020.209656:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787393020.209665:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6770:x1874217338416512:12345-0@lo:5: 00002000:00080000:1.0:1787393020.215533:0:6625:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787393020.215554:0:6625:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787393020.220484:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6770:x1874217338416512:12345-0@lo:5: Request processed in 10812us (11042us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787393020.220497:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787393020.228389:0:6770:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de835328e00 x1874217338416512/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787393036 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393020.228406:0:6770:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787393020.228423:0:6770:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9de835328e00 x1874217338416512/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787393036 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393020.228436:0:6770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6770:1874217338416512:0@lo:5: 00000004:00080000:0.0:1787393020.228452:0:6770:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1787393020.392371:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393021.417400:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393022.439937:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393023.467250:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787393023.541532:0:6992:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787393024.487984:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393025.384803:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338416640:0@lo:400: 00000100:00100000:3.0:1787393025.384899:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393025.384946:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787393025.384952:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338417024:0@lo:400: 00000100:00100000:3.0:1787393025.384987:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393025.385012:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338416768:0@lo:400: 00000100:00100000:3.0:1787393025.385032:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393025.385047:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787393025.385052:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338416896:0@lo:400: 00000100:00100000:3.0:1787393025.385080:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393025.385111:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338417024 00000100:00100000:3.0:1787393025.385118:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338417024 00000100:00100000:3.0:1787393025.385179:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787393025.385200:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3327:x1874217338417024:12345-0@lo:400: 00000100:00100000:3.0:1787393025.385248:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3327:x1874217338417024:12345-0@lo:400: Request processed in 49us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393025.385255:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787393025.385275:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338416768 00000100:00100000:3.0:1787393025.385279:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338416768 00000100:00100000:3.0:1787393025.385299:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338416896 00000100:00100000:3.0:1787393025.385302:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338416896 00000100:00100000:3.0:1787393025.385318:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787393025.385324:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338416768:12345-0@lo:400: 00000100:00100000:3.0:1787393025.385358:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338416768:12345-0@lo:400: Request processed in 34us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393025.385363:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787393025.385374:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787393025.385380:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338416896:12345-0@lo:400: 00000100:00100000:3.0:1787393025.385405:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338416896:12345-0@lo:400: Request processed in 26us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393025.385411:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787393025.385429:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787393025.385433:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787393025.385463:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de82c8d0a80 x1874217338416896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393025.385476:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338416896:0@lo:400: 00010000:00080000:3.0:1787393025.385485:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de82c8d2d80 x1874217338416768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393025.385493:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338416768:0@lo:400: 00010000:00080000:3.0:1787393025.385533:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de82c8d1880 x1874217338417024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393025.385542:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338417024:0@lo:400: 00000100:00100000:1.0:1787393025.385783:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338416640 00000100:00100000:1.0:1787393025.385788:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338416640 00000100:00100000:1.0:1787393025.385826:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787393025.385834:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+16:3327:x1874217338416640:12345-0@lo:400: 00000100:00100000:1.0:1787393025.385898:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+16:3327:x1874217338416640:12345-0@lo:400: Request processed in 64us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393025.385903:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787393025.386017:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338416640:0@lo:400: 00000100:00100000:1.0:1787393025.386352:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338417152:0@lo:13: 00000100:00100000:1.0:1787393025.386382:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393025.392146:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338417152 00000100:00100000:0.0:1787393025.392173:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338417152 00000100:00100000:0.0:1787393025.392245:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787393025.392255:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3327:x1874217338417152:12345-0@lo:13: 00002000:00000024:0.0:1787393025.392292:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393025.392370:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3327:x1874217338417152:12345-0@lo:13: Request processed in 117us (5987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393025.392377:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787393025.392423:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de83c63f800 x1874217338417152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393025.392443:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338417152:0@lo:13: 00000001:00080000:3.0:1787393025.438940:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1787393025.516125:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393026.535964:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393027.560196:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393028.584987:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393029.608240:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393030.505551:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338417280:0@lo:13: 00000100:00100000:3.0:1787393030.505650:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393030.505797:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338417280 00000100:00100000:0.0:1787393030.505808:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338417280 00000100:00100000:0.0:1787393030.505913:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787393030.505930:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338417280:12345-0@lo:13: 00002000:00000024:0.0:1787393030.505975:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393030.506042:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338417280:12345-0@lo:13: Request processed in 120us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393030.506050:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787393030.506096:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de83c63f800 x1874217338417280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393030.506109:0:3324:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787393030.506134:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338417280:0@lo:13: 00000100:00100000:0.0:1787393030.506362:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874217338417536:0@lo:400: 00000100:00100000:0.0:1787393030.506402:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393030.506447:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787393030.506454:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338417664:0@lo:400: 00000100:00100000:0.0:1787393030.506479:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393030.506514:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338417536 00000100:00100000:0.0:1787393030.506519:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338417536 00000100:00100000:0.0:1787393030.506549:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338417664 00000100:00100000:0.0:1787393030.506552:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338417664 00000100:00100000:0.0:1787393030.506571:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787393030.506578:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1874217338417536:12345-0@lo:400: 00000100:00100000:0.0:1787393030.506620:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1874217338417536:12345-0@lo:400: Request processed in 42us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393030.506627:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787393030.506640:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787393030.506645:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338417664:12345-0@lo:400: 00000100:00100000:0.0:1787393030.506673:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338417664:12345-0@lo:400: Request processed in 28us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393030.506679:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787393030.506712:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de83c63ea00 x1874217338417664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393030.506725:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338417664:0@lo:400: 00010000:00080000:0.0:1787393030.506736:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de83c63ce00 x1874217338417536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393030.506744:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874217338417536:0@lo:400: 00000100:00100000:0.0:1787393030.506761:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787393030.506768:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338417408:0@lo:400: 00000100:00100000:0.0:1787393030.506802:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393030.506897:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338417408 00000100:00100000:0.0:1787393030.506901:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338417408 00000100:00100000:0.0:1787393030.506931:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787393030.506938:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+16:3324:x1874217338417408:12345-0@lo:400: 00000100:00100000:0.0:1787393030.506972:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+16:3324:x1874217338417408:12345-0@lo:400: Request processed in 34us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393030.506979:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787393030.507014:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338417408:0@lo:400: 00000100:00080000:3.0:1787393030.507103:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787393030.507110:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787393030.632671:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393031.656196:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393032.687827:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393033.710574:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787393034.120163:0:7511:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787393034.120167:0:7511:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787393034.120303:0:7511:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9de834a79800 00000020:01000004:3.0:1787393034.120319:0:7511:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787393034.120332:0:7511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787393034.120344:0:7511:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9de834ed0000) 00000020:00000080:3.0:1787393034.120360:0:7511:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787393034.163734:0:7511:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787393034.164675:0:7511:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787393034.240476:0:7511:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787393034.259665:0:7511:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787393034.259700:0:7511:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787393034.259758:0:7511:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787393034.259784:0:7511:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787393034.261562:0:7511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787393034.261574:0:7511:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787393034.261583:0:7511:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x19a927d9c62f1231 00000020:01000004:2.0:1787393034.261591:0:7511:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787393034.261612:0:7511:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787393034.261615:0:7511:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787393034.261622:0:7511:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787393034.261642:0:7511:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787393034.261646:0:7511:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.121@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787393034.329521:0:7511:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787393034.329565:0:7511:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.121@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787393034.329569:0:7511:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787393034.329570:0:7511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787393034.329572:0:7511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787393034.329573:0:7511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787393034.329574:0:7511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787393034.329576:0:7511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787393034.329577:0:7511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787393034.329579:0:7511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787393034.329580:0:7511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787393034.329582:0:7511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787393034.329583:0:7511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787393034.329586:0:7511:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787393034.329588:0:7511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787393034.329589:0:7511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787393034.329590:0:7511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787393034.329591:0:7511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787393034.329593:0:7511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787393034.329594:0:7511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787393034.329595:0:7511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787393034.329596:0:7511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787393034.329597:0:7511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787393034.329598:0:7511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787393034.329599:0:7511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787393034.329623:0:7511:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787393034.329641:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338417792:0@lo:253: 00000100:00100000:0.0:1787393034.329733:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393034.329781:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808313480 going to sleep for 11 seconds 00000100:00100000:3.0:1787393034.330004:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338417792 00000100:00100000:3.0:1787393034.330013:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338417792 00000100:00100000:3.0:1787393034.330065:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787393034.330074:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+16:7511:x1874217338417792:12345-0@lo:253: 20000000:01000000:3.0:1787393034.330111:0:5815:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787393034.330115:0:5815:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787393034.330120:0:5815:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787393034.330123:0:5815:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787393034.331127:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787393034.331351:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787393034.331365:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787393034.331404:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787393034.331412:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787393034.331440:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787393034.331488:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787393034.331883:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787393034.331901:0:5815:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.121@tcp 20000000:01000000:3.0:1787393034.331903:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.121@tcp (null) (null) (null) 00000040:00080000:3.0:1787393034.331937:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787393034.331945:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787393034.332008:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787393034.332017:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.121@tcp (null) (null) 00000040:00080000:3.0:1787393034.332050:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787393034.332059:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787393034.332086:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787393034.332148:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787393034.332768:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787393034.332787:0:5815:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.121@tcp 20000000:01000000:3.0:1787393034.332789:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.121@tcp (null) (null) (null) 00000040:00080000:3.0:1787393034.332821:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787393034.332829:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787393034.337794:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787393034.337821:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.121@tcp (null) (null) 00000040:00080000:3.0:1787393034.337984:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787393034.338006:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787393034.338103:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787393034.338493:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787393034.338519:0:5815:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787393034.338521:0:5815:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787393034.338525:0:5815:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787393034.338545:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787393034.338548:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787393034.338659:0:5815:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787393034.338661:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787393034.344545:0:7513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787393034.344653:0:7513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787393034.344689:0:7513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787393034.345610:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787393034.345663:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787393034.345724:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787393034.346336:0:5815:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787393034.346340:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787393034.347936:0:7514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787393034.348287:0:7514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787393034.348353:0:7514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787393034.349630:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787393034.349678:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787393034.349708:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787393034.349721:0:5815:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787393034.349723:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787393034.350372:0:7515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787393034.350593:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787393034.350632:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787393034.350688:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787393034.350699:0:5815:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787393034.350701:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787393034.351466:0:7516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1787393034.351535:0:7516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1787393034.351593:0:7516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787393034.352296:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787393034.352346:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787393034.352428:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787393034.352446:0:5815:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787393034.352449:0:5815:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787393034.352458:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787393034.352478:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f1238 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.352495:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f1189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1182 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.352503:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de801530400/0x19a927d9c62f11b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f11ac expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.352510:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de801530600/0x19a927d9c62f11dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f11d6 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.352515:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de8040d8000/0x19a927d9c62f11f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f11f2 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.352521:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de800031a00/0x19a927d9c62f1223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f121c expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.352528:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f1238 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.352563:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de800031a00/0x19a927d9c62f1223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f121c expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.352588:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de800031a00/0x19a927d9c62f1223 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f121c expref: 16 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393034.352602:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5815:1874217338417920:0@lo:104: 00000100:00100000:2.0:1787393034.352663:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787393034.352712:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de8040d8000/0x19a927d9c62f11f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f11f2 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.352721:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de8040d8000/0x19a927d9c62f11f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f11f2 expref: 16 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393034.352729:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5815:1874217338418048:0@lo:104: 00000100:00100000:0.0:1787393034.352821:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787393034.356795:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338417920 00000100:00100000:1.0:1787393034.356810:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338417920 00000100:00100000:1.0:1787393034.356900:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787393034.356910:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de806fee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+3:5815:x1874217338417920:12345-0@lo:104: 00010000:00010000:1.0:1787393034.356926:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de8040d8800/0x19a927d9c62f121c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1223 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.357262:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787393034.357269:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de806fee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+3:5815:x1874217338417920:12345-0@lo:104: Request processed in 361us (4605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393034.357276:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787393034.357329:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787393034.357336:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8040d8800/0x19a927d9c62f121c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1223 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.357344:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8800 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1787393034.357349:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8800/0x19a927d9c62f121c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f1223 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.357358:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8040d8800/0x19a927d9c62f121c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f1223 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393034.357366:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8800/0x19a927d9c62f121c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f1223 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393034.357372:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787393034.357416:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8040d8800/0x19a927d9c62f121c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1223 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.357422:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787393034.357442:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8800/0x19a927d9c62f121c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1223 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.357448:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8040d8800/0x19a927d9c62f121c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1223 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.357476:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393034.357477:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393034.357479:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393034.357494:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338418176:0@lo:103: 00000100:00100000:1.0:1787393034.357529:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393034.362149:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338418176 00000100:00100000:2.0:1787393034.362164:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338418176 00010000:00010000:2.0:1787393034.362208:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de800031a00/0x19a927d9c62f1223 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f121c expref: 17 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393034.362254:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787393034.362264:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:3324:x1874217338418176:12345-0@lo:103: 00010000:00010000:2.0:1787393034.362278:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393034.362283:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de800031a00/0x19a927d9c62f1223 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f121c expref: 17 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.362296:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de800031a00/0x19a927d9c62f1223 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f121c expref: 17 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.362318:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393034.362404:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:3324:x1874217338418176:12345-0@lo:103: Request processed in 141us (4874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393034.362426:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787393034.362654:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338418176:0@lo:103: 00000100:00100000:1.0:1787393034.362712:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787393034.362783:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de801530600/0x19a927d9c62f11dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f11d6 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.362803:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de801530600/0x19a927d9c62f11dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f11d6 expref: 16 pid: 5815 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393034.362816:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5815:1874217338418304:0@lo:104: 00000100:00100000:1.0:1787393034.363133:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787393034.363172:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de801530400/0x19a927d9c62f11b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f11ac expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.363180:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de801530400/0x19a927d9c62f11b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f11ac expref: 16 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393034.363188:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5815:1874217338418432:0@lo:104: 00000100:00100000:1.0:1787393034.363228:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787393034.363247:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f1189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f1182 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.363255:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f1189 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f1182 expref: 16 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393034.363270:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5815:1874217338418560:0@lo:104: 00000100:00100000:1.0:1787393034.363290:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393034.363300:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a19c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787393034.363314:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de800031a00/0x19a927d9c62f1223 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f121c expref: 16 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393034.363328:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5815:1874217338417920:0@lo:104: 00000100:00100000:0.0:1787393034.363378:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338418048 00000100:00100000:0.0:1787393034.363384:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338418048 00000100:00100000:0.0:1787393034.363410:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338418304 00000100:00100000:0.0:1787393034.363413:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338418304 00000100:00100000:0.0:1787393034.363423:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338418432 00000100:00100000:0.0:1787393034.363424:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338418432 00000100:00100000:0.0:1787393034.363432:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338418560 00000100:00100000:0.0:1787393034.363434:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338418560 00000100:00100000:0.0:1787393034.363446:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787393034.363453:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+6:5815:x1874217338418048:12345-0@lo:104: 00010000:00010000:0.0:1787393034.363465:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f11f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f11f9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393034.363517:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787393034.363523:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+6:5815:x1874217338418048:12345-0@lo:104: Request processed in 71us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393034.363529:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787393034.363545:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787393034.363551:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+5:5815:x1874217338418304:12345-0@lo:104: 00010000:00010000:0.0:1787393034.363558:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de8029e2a00/0x19a927d9c62f11d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f11dd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393034.363595:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787393034.363601:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+5:5815:x1874217338418304:12345-0@lo:104: Request processed in 50us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393034.363606:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787393034.363618:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787393034.363624:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+4:5815:x1874217338418432:12345-0@lo:104: 00010000:00010000:0.0:1787393034.363630:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f11ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f11b3 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393034.363650:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787393034.363655:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+4:5815:x1874217338418432:12345-0@lo:104: Request processed in 32us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393034.363660:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787393034.363668:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787393034.363672:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:5815:x1874217338418560:12345-0@lo:104: 00010000:00010000:0.0:1787393034.363678:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f1182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1189 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393034.363695:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787393034.363699:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:5815:x1874217338418560:12345-0@lo:104: Request processed in 27us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393034.363704:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787393034.364085:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787393034.364091:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f11f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f11f9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364098:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8029e2800 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1787393034.364102:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f11f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f11f9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364111:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f11f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f11f9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393034.364118:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f11f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f11f9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393034.364124:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787393034.364156:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f11f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f11f9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364163:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787393034.364180:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f11f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f11f9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364196:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f11f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f11f9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364209:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787393034.364212:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8029e2a00/0x19a927d9c62f11d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f11dd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364218:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8029e2a00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1787393034.364220:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e2a00/0x19a927d9c62f11d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f11dd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364227:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8029e2a00/0x19a927d9c62f11d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f11dd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393034.364233:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e2a00/0x19a927d9c62f11d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f11dd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393034.364237:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787393034.364251:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8029e2a00/0x19a927d9c62f11d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f11dd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364256:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787393034.364270:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8029e2a00/0x19a927d9c62f11d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f11dd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364276:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8029e2a00/0x19a927d9c62f11d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f11dd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364297:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787393034.364304:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f11ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f11b3 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364309:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8400 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1787393034.364312:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f11ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f11b3 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364318:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f11ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f11b3 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393034.364324:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f11ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f11b3 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393034.364328:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787393034.364342:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f11ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f11b3 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364348:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787393034.364353:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f11ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f11b3 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364359:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f11ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f11b3 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364369:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787393034.364372:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f1182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1189 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364378:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8029e3800 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1787393034.364380:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f1182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f1189 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364396:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f1182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f1189 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393034.364401:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f1182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f1189 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393034.364406:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787393034.364419:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f1182 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1189 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364424:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787393034.364429:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f1182 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1189 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364435:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f1182 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1189 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.364449:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393034.364451:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393034.364452:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393034.364465:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338418688:0@lo:103: 00000100:00100000:1.0:1787393034.364497:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393034.364526:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787393034.364531:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338419072:0@lo:103: 00000100:00100000:1.0:1787393034.364562:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393034.364591:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338418816:0@lo:103: 00000100:00100000:1.0:1787393034.364610:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393034.364627:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787393034.364637:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338418944:0@lo:103: 00000100:00100000:1.0:1787393034.364655:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393034.364674:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338418688 00000100:00100000:1.0:1787393034.364679:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338418688 00010000:00010000:1.0:1787393034.364696:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de8040d8000/0x19a927d9c62f11f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f11f2 expref: 16 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393034.364709:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338419072 00000100:00100000:1.0:1787393034.364711:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338419072 00010000:00010000:1.0:1787393034.364719:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f1189 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1182 expref: 17 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393034.364727:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338418816 00000100:00100000:1.0:1787393034.364729:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338418816 00000100:00100000:2.0:1787393034.366228:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338418944 00000100:00100000:2.0:1787393034.366239:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338418944 00010000:00010000:2.0:1787393034.366270:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de801530400/0x19a927d9c62f11b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f11ac expref: 19 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393034.366295:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787393034.366303:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338418688:12345-0@lo:103: 00010000:00010000:2.0:1787393034.366315:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393034.366321:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de8040d8000/0x19a927d9c62f11f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f11f2 expref: 19 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.366332:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de8040d8000/0x19a927d9c62f11f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f11f2 expref: 19 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.366350:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393034.366405:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338418688:12345-0@lo:103: Request processed in 102us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393034.366411:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787393034.366429:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787393034.366434:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+18:3325:x1874217338419072:12345-0@lo:103: 00010000:00010000:2.0:1787393034.366442:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393034.366447:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f1189 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1182 expref: 18 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.366454:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f1189 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f1182 expref: 18 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.366462:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393034.366495:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+18:3325:x1874217338419072:12345-0@lo:103: Request processed in 61us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393034.366502:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787393034.366514:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787393034.366520:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:3326:x1874217338418944:12345-0@lo:103: 00010000:00010000:2.0:1787393034.366526:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393034.366530:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de801530400/0x19a927d9c62f11b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f11ac expref: 17 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.366537:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de801530400/0x19a927d9c62f11b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f11ac expref: 17 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.366545:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393034.366569:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:3326:x1874217338418944:12345-0@lo:103: Request processed in 49us (1912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393034.366574:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787393034.366612:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338418944:0@lo:103: 00000100:00100000:2.0:1787393034.366640:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338419072:0@lo:103: 00000100:00100000:2.0:1787393034.366649:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338418688:0@lo:103: 00010000:00010000:0.0:1787393034.367004:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8040d8000/0x19a927d9c62f11f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f11f2 expref: 16 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393034.367018:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5815:1874217338418048:0@lo:104: 00000100:00100000:0.0:1787393034.367044:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5815:1874217338418304:0@lo:104: 00010000:00010000:0.0:1787393034.367053:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de801530400/0x19a927d9c62f11b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f11ac expref: 15 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393034.367062:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5815:1874217338418432:0@lo:104: 00010000:00010000:0.0:1787393034.367072:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f1189 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f1182 expref: 14 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.367078:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393034.367080:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5815:1874217338418560:0@lo:104: 00010000:00010000:0.0:1787393034.367111:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f1238 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.367333:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de801530600/0x19a927d9c62f11dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f11d6 expref: 18 pid: 5815 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393034.367363:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787393034.367373:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+13:3326:x1874217338418816:12345-0@lo:103: 00010000:00010000:1.0:1787393034.367383:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393034.367388:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de801530600/0x19a927d9c62f11dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f11d6 expref: 13 pid: 5815 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.367398:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de801530600/0x19a927d9c62f11dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f11d6 expref: 13 pid: 5815 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.367408:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de801530600/0x19a927d9c62f11dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f11d6 expref: 13 pid: 5815 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.367420:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f1238 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.367438:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f1238 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.367453:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f1238 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.367459:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f1238 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.367465:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f1238 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.367471:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f1238 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.367477:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8029e3000 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:1.0:1787393034.367481:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f1238 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.367488:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f1238 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.367506:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f1238 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.367516:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393034.367554:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:3326:x1874217338418816:12345-0@lo:103: Request processed in 185us (2942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393034.367561:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787393034.367686:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338418816:0@lo:103: 00010000:00010000:0.0:1787393034.367735:0:5815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f1238 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393034.368297:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f1238 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393034.368303:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f1238 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787393034.368318:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787393034.450597:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+11:7511:x1874217338417792:12345-0@lo:253: Request processed in 120516us (120855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393034.450612:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787393034.450633:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338417792:0@lo:253: 10000000:01000000:2.0:1787393034.450646:0:7511:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787393034.450650:0:7511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787393034.450651:0:7511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787393034.450653:0:7511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787393034.450654:0:7511:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787393034.450655:0:7511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787393034.450657:0:7511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787393034.450658:0:7511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787393034.450672:0:7511:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787393034.450673:0:7511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787393034.450675:0:7511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787393034.450695:0:7511:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9de834a79800 from lustre-OST0001 10000000:01000000:2.0:1787393034.450717:0:7511:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787393034.450720:0:7511:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787393034.450728:0:7511:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9de8180e99c0 local copy 10000000:01000000:2.0:1787393034.450732:0:7511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787393034.450764:0:7511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f123f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.450775:0:7511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f123f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.450784:0:7511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f123f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393034.450801:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338419200:0@lo:101: 00000100:00100000:2.0:1787393034.450829:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393034.450875:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338419200 00000100:00100000:0.0:1787393034.450883:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338419200 00000100:00100000:0.0:1787393034.450933:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787393034.450941:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+11:7511:x1874217338419200:12345-0@lo:101: 00010000:00010000:0.0:1787393034.450962:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393034.450974:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de800031800/0x19a927d9c62f1246 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f123f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393034.451003:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a1480 going to sleep for 11 seconds 00010000:00010000:0.0:1787393034.451003:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de800031800/0x19a927d9c62f1246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f123f expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393034.451013:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de800031800/0x19a927d9c62f1246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f123f expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393034.451021:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800031800, rc 0) 00000100:00100000:0.0:1787393034.451056:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:7511:x1874217338419200:12345-0@lo:101: Request processed in 115us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393034.451062:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787393034.451093:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338419200:0@lo:101: 00010000:00010000:2.0:1787393034.451107:0:7511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f123f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x19a927d9c62f1246 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.451115:0:7511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f123f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x19a927d9c62f1246 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393034.451196:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338419328:0@lo:501: 00000100:00100000:2.0:1787393034.451214:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393034.451229:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1787393034.451380:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338419328 00000100:00100000:0.0:1787393034.451385:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338419328 00000100:00100000:0.0:1787393034.451411:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787393034.451418:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:7511:x1874217338419328:12345-0@lo:501: 00000100:00100000:0.0:1787393034.451608:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:7511:x1874217338419328:12345-0@lo:501: Request processed in 190us (391us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787393034.451614:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787393034.451695:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338419328:0@lo:501: 10000000:01000000:2.0:1787393034.451713:0:7511:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787393034.451735:0:7511:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787393034.451740:0:7511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f123f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x19a927d9c62f1246 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.451748:0:7511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f123f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x19a927d9c62f1246 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.451755:0:7511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f123f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x19a927d9c62f1246 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.451775:0:7511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787393034.451792:0:7511:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9de834a79800 10000000:01000000:2.0:1787393034.451796:0:7511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787393034.451800:0:7511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787393034.451803:0:7511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787393034.451806:0:7511:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787393034.451809:0:7511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787393034.451822:0:7511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2e00/0x19a927d9c62f124d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.451827:0:7511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8029e2e00/0x19a927d9c62f124d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.451833:0:7511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8029e2e00/0x19a927d9c62f124d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393034.451859:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338419456:0@lo:101: 00000100:00100000:2.0:1787393034.451877:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393034.451904:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787393034.451915:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338419456 00000100:00100000:0.0:1787393034.451919:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338419456 00000100:00100000:0.0:1787393034.452029:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787393034.452036:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:7511:x1874217338419456:12345-0@lo:101: 00010000:00010000:0.0:1787393034.452044:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393034.452053:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de800030800/0x19a927d9c62f1254 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f124d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393034.452078:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de800030800/0x19a927d9c62f1254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f124d expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393034.452087:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de800030800/0x19a927d9c62f1254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f124d expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393034.452095:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800030800, rc 0) 00000100:00100000:0.0:1787393034.452129:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:7511:x1874217338419456:12345-0@lo:101: Request processed in 93us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393034.452134:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787393034.452217:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338419456:0@lo:101: 00010000:00010000:2.0:1787393034.452228:0:7511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8029e2e00/0x19a927d9c62f124d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1254 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.452236:0:7511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8029e2e00/0x19a927d9c62f124d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f1254 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393034.452296:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338419584:0@lo:501: 00000100:00100000:2.0:1787393034.452319:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393034.452339:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a16c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787393034.452376:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787393034.452388:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f123f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x19a927d9c62f1246 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.452399:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8029e3200 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1787393034.452403:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f123f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x19a927d9c62f1246 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.452411:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f123f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x19a927d9c62f1246 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393034.452418:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f123f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x19a927d9c62f1246 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393034.452423:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787393034.452441:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f123f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x19a927d9c62f1246 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.452446:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787393034.452488:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338419712:0@lo:103: 00000100:00100000:2.0:1787393034.452515:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393034.452580:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338419712 00000100:00100000:3.0:1787393034.452585:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338419712 00000100:00100000:3.0:1787393034.452617:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787393034.452625:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+13:3325:x1874217338419712:12345-0@lo:103: 00010000:00010000:3.0:1787393034.452632:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393034.452641:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de800031800/0x19a927d9c62f1246 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a927d9c62f123f expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.452650:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393034.452694:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338419584 00000100:00100000:0.0:1787393034.452697:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338419584 00000100:00100000:0.0:1787393034.452713:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787393034.452716:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+13:7511:x1874217338419584:12345-0@lo:501: 00000100:00100000:0.0:1787393034.452909:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+13:7511:x1874217338419584:12345-0@lo:501: Request processed in 190us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393034.452916:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787393034.452952:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338419584:0@lo:501: 00000100:00100000:0.0:1787393034.452981:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338419840:0@lo:503: 00000100:00100000:0.0:1787393034.453038:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787393034.453045:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f123f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x19a927d9c62f1246 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.453053:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f123f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x19a927d9c62f1246 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393034.453057:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808313cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1787393034.453064:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393034.453065:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393034.453067:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393034.453068:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338419840 00000100:00100000:0.0:1787393034.453071:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338419840 00000100:00100000:0.0:1787393034.453094:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787393034.453100:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:7511:x1874217338419840:12345-0@lo:503: 00000100:00100000:0.0:1787393034.453252:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:7511:x1874217338419840:12345-0@lo:503: Request processed in 152us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393034.453263:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787393034.453483:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338419840:0@lo:503: 00000040:00080000:1.0:1787393034.453707:0:7511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787393034.453756:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338419968:0@lo:502: 00000100:00100000:1.0:1787393034.453792:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393034.453812:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83c92a240 going to sleep for 11 seconds 00000100:00100000:0.0:1787393034.453865:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338419968 00000100:00100000:0.0:1787393034.453869:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338419968 00000100:00100000:0.0:1787393034.453896:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787393034.453902:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+13:7511:x1874217338419968:12345-0@lo:502: 00000100:00100000:3.0:1787393034.454088:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+13:3325:x1874217338419712:12345-0@lo:103: Request processed in 1463us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393034.454104:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787393034.454172:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338419712:0@lo:103: 00000100:00100000:0.0:1787393034.454267:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+12:7511:x1874217338419968:12345-0@lo:502: Request processed in 365us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393034.454272:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787393034.454322:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338419968:0@lo:502: 00000040:00080000:1.0:1787393034.454548:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787393034.454597:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787393034.454628:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787393034.454676:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787393034.454711:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787393034.454744:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787393034.454767:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338420096:0@lo:502: 00000100:00100000:1.0:1787393034.454804:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393034.454925:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83c92a240 going to sleep for 11 seconds 00000100:00100000:0.0:1787393034.455068:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338420096 00000100:00100000:0.0:1787393034.455074:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338420096 00000100:00100000:0.0:1787393034.455209:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787393034.455218:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:7511:x1874217338420096:12345-0@lo:502: 00000100:00100000:0.0:1787393034.455373:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+12:7511:x1874217338420096:12345-0@lo:502: Request processed in 156us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393034.455380:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787393034.455452:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338420096:0@lo:502: 00000040:00080000:2.0:1787393034.455613:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787393034.455627:0:7511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787393034.458466:0:7517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787393034.458479:0:7517:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787393034.458486:0:7517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393034.458488:0:7517:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787393034.458496:0:7517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787393034.458510:0:7517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9de8180e8000) 00000020:00000080:0.0:1787393034.458532:0:7517:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787393034.458538:0:7517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787393034.458601:0:7517:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9de834a79800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787393034.458606:0:7517:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787393034.458610:0:7517:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x19a927d9c62f1262 00010000:00010000:0.0:1787393034.461562:0:7517:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1787393034.461881:0:7517:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787393034.465337:0:7517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787393034.465628:0:7517:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787393034.469408:0:7517:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787393034.469752:0:7517:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787393034.470751:0:7517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787393034.470759:0:7517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787393034.470763:0:7517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393034.470765:0:7517:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787393034.470768:0:7517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787393034.470770:0:7517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393034.470771:0:7517:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787393034.470773:0:7517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787393034.470774:0:7517:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787393034.470808:0:7517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787393034.470809:0:7517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393034.470810:0:7517:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787393034.470812:0:7517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787393034.470903:0:7511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787393034.470928:0:7511:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787393034.470952:0:7511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2e00/0x19a927d9c62f124d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1254 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.470964:0:7511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8029e2e00/0x19a927d9c62f124d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1254 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393034.470972:0:7511:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de834a79800 from 1 10000000:01000000:2.0:1787393034.470975:0:7511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787393034.471027:0:7511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e3400/0x19a927d9c62f1269 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.471041:0:7511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8029e3400/0x19a927d9c62f1269 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.471052:0:7511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8029e3400/0x19a927d9c62f1269 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393034.471074:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338420224:0@lo:101: 00000100:00100000:2.0:1787393034.472666:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393034.472724:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787393034.472830:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338420224 00000100:00100000:3.0:1787393034.472857:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338420224 00000100:00100000:3.0:1787393034.472902:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787393034.472910:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+12:7511:x1874217338420224:12345-0@lo:101: 00010000:00010000:3.0:1787393034.472922:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393034.472938:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1270 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f1269 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.472961:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1270 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f1269 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.472970:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1270 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1269 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.472979:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531a00, rc 0) 00000100:00100000:3.0:1787393034.473046:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+13:7511:x1874217338420224:12345-0@lo:101: Request processed in 137us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393034.473061:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787393034.473192:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338420224:0@lo:101: 00010000:00010000:2.0:1787393034.473212:0:7511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8029e3400/0x19a927d9c62f1269 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1270 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.473221:0:7511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8029e3400/0x19a927d9c62f1269 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f1270 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393034.473332:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338420352:0@lo:501: 00000100:00100000:2.0:1787393034.473362:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393034.473419:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787393034.473458:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338420352 00000100:00100000:0.0:1787393034.473463:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338420352 00000100:00100000:0.0:1787393034.473526:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787393034.473534:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:7511:x1874217338420352:12345-0@lo:501: 00000100:00100000:0.0:1787393034.473756:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:7511:x1874217338420352:12345-0@lo:501: Request processed in 222us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393034.473762:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787393034.473820:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338420352:0@lo:501: 00000100:00100000:2.0:1787393034.473871:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338420480:0@lo:503: 00000100:00100000:2.0:1787393034.473905:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393034.474030:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787393034.474058:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338420480 00000100:00100000:3.0:1787393034.474062:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338420480 00000100:00100000:3.0:1787393034.474081:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787393034.474087:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+13:7511:x1874217338420480:12345-0@lo:503: 00000100:00100000:3.0:1787393034.474360:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+13:7511:x1874217338420480:12345-0@lo:503: Request processed in 272us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393034.474367:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787393034.474478:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338420480:0@lo:503: 00000040:00080000:2.0:1787393034.474717:0:7511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787393034.474776:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338420608:0@lo:502: 00000100:00100000:2.0:1787393034.474810:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393034.475035:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787393034.475068:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338420608 00000100:00100000:3.0:1787393034.475072:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338420608 00000100:00100000:3.0:1787393034.475142:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787393034.475150:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+13:7511:x1874217338420608:12345-0@lo:502: 00000100:00100000:3.0:1787393034.475308:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+13:7511:x1874217338420608:12345-0@lo:502: Request processed in 158us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393034.475315:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787393034.475374:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338420608:0@lo:502: 00000040:00080000:2.0:1787393034.475593:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787393034.475641:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787393034.475666:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338420736:0@lo:502: 00000100:00100000:2.0:1787393034.475699:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393034.475797:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787393034.475825:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338420736 00000100:00100000:0.0:1787393034.475829:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338420736 00000100:00100000:0.0:1787393034.475985:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787393034.476000:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:7511:x1874217338420736:12345-0@lo:502: 00000100:00100000:0.0:1787393034.476132:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:7511:x1874217338420736:12345-0@lo:502: Request processed in 140us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393034.476139:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787393034.476292:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338420736:0@lo:502: 00000040:00080000:2.0:1787393034.476373:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787393034.476384:0:7511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787393034.476969:0:7521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787393034.476980:0:7521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393034.476982:0:7521:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787393034.476999:0:7521:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9de834a79800 00000020:00000080:0.0:1787393034.477003:0:7521:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787393034.477024:0:7521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787393034.477027:0:7521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393034.477028:0:7521:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787393034.477032:0:7521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787393034.477166:0:7511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787393034.477188:0:7511:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787393034.477240:0:7511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e3400/0x19a927d9c62f1269 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1270 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.477252:0:7511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8029e3400/0x19a927d9c62f1269 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1270 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393034.477288:0:7511:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787393034.477291:0:7511:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9de834a79800 10000000:01000000:2.0:1787393034.477294:0:7511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9de834a79800 10000000:01000000:2.0:1787393034.477297:0:7511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787393034.477302:0:7511:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9de834a79800 from 1 10000000:01000000:2.0:1787393034.477305:0:7511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787393034.477331:0:7511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.477349:0:7511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.477359:0:7511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393034.477375:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338420864:0@lo:101: 00000100:00100000:2.0:1787393034.477421:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393034.477488:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787393034.477541:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338420864 00000100:00100000:0.0:1787393034.477546:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338420864 00000100:00100000:0.0:1787393034.477799:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787393034.477809:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+13:7511:x1874217338420864:12345-0@lo:101: 00010000:00010000:0.0:1787393034.477819:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393034.477832:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de800031800/0x19a927d9c62f127e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f1277 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393034.477926:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de800031800/0x19a927d9c62f127e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f1277 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393034.477936:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de800031800/0x19a927d9c62f127e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1277 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393034.477944:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800031800, rc 0) 00000100:00100000:0.0:1787393034.478028:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+14:7511:x1874217338420864:12345-0@lo:101: Request processed in 220us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393034.478035:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787393034.478124:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338420864:0@lo:101: 00010000:00010000:2.0:1787393034.478139:0:7511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1277 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f127e expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393034.478147:0:7511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1277 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f127e expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393034.478223:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338420992:0@lo:501: 00000100:00100000:2.0:1787393034.478251:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393034.478281:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787393034.478323:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338420992 00000100:00100000:3.0:1787393034.478329:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338420992 00000100:00100000:3.0:1787393034.478360:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787393034.478367:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:7511:x1874217338420992:12345-0@lo:501: 00000100:00100000:3.0:1787393034.478562:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:7511:x1874217338420992:12345-0@lo:501: Request processed in 195us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393034.478569:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787393034.478634:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338420992:0@lo:501: 00000100:00100000:2.0:1787393034.478658:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338421120:0@lo:503: 00000100:00100000:2.0:1787393034.478692:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393034.478712:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787393034.478751:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338421120 00000100:00100000:3.0:1787393034.478754:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338421120 00000100:00100000:3.0:1787393034.478782:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787393034.478788:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:7511:x1874217338421120:12345-0@lo:503: 00000100:00100000:3.0:1787393034.478939:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:7511:x1874217338421120:12345-0@lo:503: Request processed in 151us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393034.478945:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787393034.479031:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338421120:0@lo:503: 00000040:00080000:2.0:1787393034.479247:0:7511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787393034.479310:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338421248:0@lo:502: 00000100:00100000:2.0:1787393034.479341:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393034.479372:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787393034.479415:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338421248 00000100:00100000:3.0:1787393034.479420:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338421248 00000100:00100000:3.0:1787393034.479449:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787393034.479456:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:7511:x1874217338421248:12345-0@lo:502: 00000100:00100000:3.0:1787393034.479598:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:7511:x1874217338421248:12345-0@lo:502: Request processed in 143us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393034.479604:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787393034.479673:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338421248:0@lo:502: 00000040:00080000:2.0:1787393034.479920:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787393034.479963:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787393034.480001:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787393034.480042:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787393034.480073:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787393034.480121:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787393034.480154:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787393034.480186:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787393034.480244:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787393034.480280:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787393034.480310:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787393034.480351:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787393034.480385:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787393034.480416:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787393034.480465:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787393034.480497:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787393034.480524:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787393034.480566:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787393034.480596:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787393034.480621:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787393034.480654:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787393034.480694:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787393034.480724:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787393034.480765:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787393034.480796:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787393034.480824:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787393034.480886:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787393034.480926:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787393034.480956:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787393034.481008:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787393034.481048:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787393034.481095:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787393034.481139:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787393034.481173:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787393034.481196:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787393034.481234:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787393034.481257:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787393034.481284:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338421376:0@lo:502: 00000100:00100000:2.0:1787393034.481334:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393034.481372:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787393034.481421:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338421376 00000100:00100000:3.0:1787393034.481428:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338421376 00000100:00100000:3.0:1787393034.481495:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787393034.481501:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:7511:x1874217338421376:12345-0@lo:502: 00000100:00100000:3.0:1787393034.481682:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:7511:x1874217338421376:12345-0@lo:502: Request processed in 179us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393034.481689:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787393034.481762:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338421376:0@lo:502: 00000040:00080000:0.0:1787393034.481825:0:7511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787393034.481835:0:7511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787393034.482461:0:7522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787393034.482475:0:7522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9de834ed19c0) 00000020:00000080:3.0:1787393034.482494:0:7522:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787393034.482682:0:7522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9de834a79800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787393034.482685:0:7522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9de834a79800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787393034.482687:0:7522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9de834a79800 3 00010000:00080000:3.0:1787393034.482705:0:7522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9de83fd66800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.121@tcp at head 00010000:00010000:3.0:1787393034.484313:0:7522:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787393034.484403:0:7522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787393034.484441:0:7522:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787393034.484457:0:7522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x19a927d9c62f128c 00000100:00080000:3.0:1787393034.484466:0:7522:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787393034.484471:0:7522:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9de83fd66800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:3.0:1787393034.484506:0:7522:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de83532b480 x1874217338421504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787393034.484568:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3323:1874217338421504:0@lo:38: 00000100:00100000:2.0:1787393034.484639:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787393034.484705:0:7522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787393034.484754:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338421504 00000100:00100000:2.0:1787393034.484762:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338421504 00000100:00100000:2.0:1787393034.484792:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787393034.484799:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3323:x1874217338421504:12345-0@lo:38: 00010000:00080000:2.0:1787393034.484820:0:5821:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:2.0:1787393034.484873:0:5821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x19a927d9c62f1293 00000004:00100000:2.0:1787393034.484886:0:5821:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787393034.484912:0:5821:0:(import.c:65:import_set_state_nolock()) ffff9de83ca36800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787393034.484958:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1874217338421504:12345-0@lo:38: Request processed in 158us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393034.484965:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787393034.485014:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de83532b480 x1874217338421504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787393044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393034.485024:0:3323:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787393034.485037:0:3323:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787393034.485044:0:3323:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787393034.485047:0:3323:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787393034.485050:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de83fd66800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787393034.485056:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3323:1874217338421504:0@lo:38: 00000040:00080000:0.0:1787393034.486495:0:7522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1787393034.486514:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338421760:0@lo:400: 00000100:00100000:1.0:1787393034.486563:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787393034.486589:0:7511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00100000:1.0:1787393034.486592:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787393034.486597:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338421632:0@lo:400: 00000100:00100000:1.0:1787393034.486616:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1787393034.486616:0:7511:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787393034.486628:0:7511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1277 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f127e expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393034.486637:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338421888:0@lo:400: 00010000:00010000:0.0:1787393034.486639:0:7511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f127e expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393034.486658:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1787393034.486680:0:7511:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787393034.486685:0:7511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000100:00100000:1.0:1787393034.486686:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338421760 00000020:01000004:0.0:1787393034.486686:0:7511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787393034.486687:0:7511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787393034.486688:0:7511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787393034.486689:0:7511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787393034.486690:0:7511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:1.0:1787393034.486691:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338421760 00000020:01000004:0.0:1787393034.486691:0:7511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787393034.486693:0:7511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787393034.486694:0:7511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787393034.486695:0:7511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787393034.486699:0:7511:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787393034.486700:0:7511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787393034.486701:0:7511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787393034.486702:0:7511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787393034.486703:0:7511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787393034.486705:0:7511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787393034.486706:0:7511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787393034.486706:0:7511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787393034.486707:0:7511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787393034.486708:0:7511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787393034.486709:0:7511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787393034.486710:0:7511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787393034.486722:0:7511:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787393034.486728:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338421632 00000100:00100000:1.0:1787393034.486731:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338421632 00000100:00100000:0.0:1787393034.486731:0:7511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338422016:0@lo:253: 00000100:00100000:1.0:1787393034.486745:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787393034.486753:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338421760:12345-0@lo:400: 00000100:00100000:0.0:1787393034.486760:0:7511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393034.486781:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338422016 00000100:00100000:0.0:1787393034.486784:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338422016 00000100:00100000:1.0:1787393034.486792:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338421760:12345-0@lo:400: Request processed in 40us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393034.486799:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787393034.486805:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787393034.486809:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+14:7511:x1874217338422016:12345-0@lo:253: 00000100:00100000:1.0:1787393034.486816:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787393034.486821:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338421632:12345-0@lo:400: 20000000:01000000:0.0:1787393034.486827:0:5815:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1787393034.486866:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338421632:12345-0@lo:400: Request processed in 44us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393034.486871:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787393034.486887:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338421888 00000100:00100000:1.0:1787393034.486890:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338421888 00000100:00100000:1.0:1787393034.486911:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787393034.486916:0:6622:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787393034.486918:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338421888:12345-0@lo:400: 00000100:00100000:2.0:1787393034.486923:0:6622:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787393034.486948:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338421888:12345-0@lo:400: Request processed in 30us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393034.486954:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787393034.486969:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787393034.486973:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787393034.487008:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de83fcca300 x1874217338421888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393034.487021:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338421888:0@lo:400: 00010000:00080000:1.0:1787393034.487045:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de83fccb100 x1874217338421632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393034.487053:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338421632:0@lo:400: 00010000:00080000:1.0:1787393034.487062:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de83fcc9180 x1874217338421760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393034.487070:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338421760:0@lo:400: 00000100:00100000:3.0:1787393034.487146:0:7524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7524:1874217338422144:0@lo:901: 00000100:00100000:3.0:1787393034.487168:0:7524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393034.487185:0:7524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83f74ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787393034.487203:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338422144 00000100:00100000:1.0:1787393034.487207:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338422144 00000100:00100000:1.0:1787393034.487248:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787393034.487259:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7524:x1874217338422144:12345-0@lo:901: 20000000:01000000:0.0:1787393034.487271:0:5815:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787393034.487549:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7524:x1874217338422144:12345-0@lo:901: Request processed in 289us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393034.487556:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787393034.487585:0:7524:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de83532b480 x1874217338422144/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787393050 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393034.487593:0:7524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7524:1874217338422144:0@lo:901: 00000100:00080000:3.0:1787393034.487673:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393034.487715:0:7511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83c4b0000 going to sleep for 11 seconds 20000000:01000000:0.0:1787393034.509503:0:5815:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787393034.509522:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787393034.509598:0:5836:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787393034.509602:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787393034.509622:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f129a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.509636:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de801531600/0x19a927d9c62f11eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f11e4 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.509642:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f129a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.509672:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de801531600/0x19a927d9c62f11eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f11e4 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.509681:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de801531600/0x19a927d9c62f11eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f11e4 expref: 14 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393034.509692:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcc9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5836:1874217338422272:0@lo:104: 00000100:00100000:1.0:1787393034.509740:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393034.509774:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83c92ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787393034.509896:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338422272 00000100:00100000:3.0:1787393034.509904:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338422272 00000100:00100000:3.0:1787393034.509955:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787393034.509964:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:5836:x1874217338422272:12345-0@lo:104: 00010000:00010000:3.0:1787393034.510243:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f11e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f11eb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.510306:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787393034.510312:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:5836:x1874217338422272:12345-0@lo:104: Request processed in 350us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393034.510358:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcc9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5836:1874217338422272:0@lo:104: 00010000:00010000:1.0:1787393034.510376:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f129a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393034.510449:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787393034.510473:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393034.510479:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f11e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f11eb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.510486:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031c00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1787393034.510490:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f11e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f11eb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.510509:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f11e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f11eb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787393034.510516:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f11e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f11eb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393034.510522:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787393034.510554:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f11e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f11eb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.510561:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787393034.510580:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f11e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f11eb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.510587:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f11e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f11eb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.510603:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393034.510605:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393034.510606:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393034.510689:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787393034.510699:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338422400:0@lo:103: 00000100:00100000:1.0:1787393034.510726:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393034.511127:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338422400 00000100:00100000:3.0:1787393034.511134:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338422400 00010000:00010000:3.0:1787393034.511156:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de801531600/0x19a927d9c62f11eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f11e4 expref: 15 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393034.511185:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787393034.511194:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de826cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+15:3324:x1874217338422400:12345-0@lo:103: 00010000:00010000:3.0:1787393034.511204:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393034.511209:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de801531600/0x19a927d9c62f11eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f11e4 expref: 15 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.511228:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de801531600/0x19a927d9c62f11eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f11e4 expref: 15 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.511241:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de801531600/0x19a927d9c62f11eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f11e4 expref: 15 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.511254:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f129a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.511262:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f129a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787393034.511275:0:5806:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001673053s 00010000:00010000:3.0:1787393034.511279:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f129a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.511287:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f129a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.511294:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f129a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.511301:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f129a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.511307:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8400 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393034.511311:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f129a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.511319:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f129a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.511337:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f129a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393034.511347:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393034.511380:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de826cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:3324:x1874217338422400:12345-0@lo:103: Request processed in 187us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393034.511387:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787393034.511523:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338422400:0@lo:103: 00010000:00010000:1.0:1787393034.511542:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f129a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.511551:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f129a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393034.511557:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f129a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393034.517662:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+13:7511:x1874217338422016:12345-0@lo:253: Request processed in 30844us (30893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393034.517673:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787393034.517773:0:7511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28e76f01-627f-442b-bc98-cefaf6a7617a:7511:1874217338422016:0@lo:253: 10000000:01000000:0.0:1787393034.517783:0:7511:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787393034.517793:0:7511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787393034.517794:0:7511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787393034.517796:0:7511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787393034.517797:0:7511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787393034.517798:0:7511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787393034.517799:0:7511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787393034.517800:0:7511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787393034.517802:0:7511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787393034.517803:0:7511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787393034.517805:0:7511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787393034.517806:0:7511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787393034.517821:0:7511:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787393034.522559:0:7511:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787393034.522675:0:7511:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787393034.523002:0:7511:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787393034.523181:0:7511:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787393034.523392:0:7511:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787393034.523608:0:7511:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787393034.524699:0:7511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1787393034.728079:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787393034.762909:0:7511:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787393034.762916:0:7511:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787393034.762949:0:7511:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787393034.763026:0:7511:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.121@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787393034.763042:0:7511:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787393034.763062:0:7511:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:1.0:1787393035.625787:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787393035.625811:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338422528:0@lo:13: 00000100:00100000:1.0:1787393035.625900:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393035.625943:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338422528 00000100:00100000:0.0:1787393035.625951:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338422528 00000100:00100000:0.0:1787393035.626012:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787393035.626022:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338422528:12345-0@lo:13: 00002000:00000024:0.0:1787393035.626052:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393035.626093:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338422528:12345-0@lo:13: Request processed in 72us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393035.626100:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787393035.627731:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83c63ea00 x1874217338422528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393035.627753:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338422528:0@lo:13: 00010000:00010000:1.0:1787393035.753237:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393036.786569:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393037.800966:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393038.830583:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393039.726302:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338422656:0@lo:400: 00000100:00100000:3.0:1787393039.726375:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393039.726418:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338423168:0@lo:400: 00000100:00100000:3.0:1787393039.726445:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393039.726470:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787393039.726476:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338423040:0@lo:400: 00000100:00100000:3.0:1787393039.726499:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393039.726524:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338422784:0@lo:400: 00000100:00100000:3.0:1787393039.726562:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393039.726581:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787393039.726586:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338422912:0@lo:400: 00000100:00100000:3.0:1787393039.726616:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393039.726644:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338422656 00000100:00100000:3.0:1787393039.726652:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338422656 00000100:00100000:3.0:1787393039.726695:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787393039.726704:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+13:3327:x1874217338422656:12345-0@lo:400: 00000100:00100000:3.0:1787393039.726753:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+13:3327:x1874217338422656:12345-0@lo:400: Request processed in 50us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393039.726761:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787393039.726792:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338423168 00000100:00100000:3.0:1787393039.726796:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338423168 00000100:00100000:3.0:1787393039.726822:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338422784 00000100:00100000:3.0:1787393039.726825:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338422784 00000100:00100000:3.0:1787393039.726858:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338422912 00000100:00100000:3.0:1787393039.726861:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338422912 00000100:00100000:3.0:1787393039.726877:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787393039.726883:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874217338423168:12345-0@lo:400: 00000100:00100000:3.0:1787393039.726913:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874217338423168:12345-0@lo:400: Request processed in 30us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393039.726918:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787393039.726928:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787393039.726933:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338422784:12345-0@lo:400: 00000100:00100000:3.0:1787393039.726975:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338422784:12345-0@lo:400: Request processed in 40us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393039.726981:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787393039.726991:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787393039.726997:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338422912:12345-0@lo:400: 00000100:00100000:3.0:1787393039.727155:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338422912:12345-0@lo:400: Request processed in 157us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393039.727166:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787393039.727185:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338423040 00000100:00100000:3.0:1787393039.727189:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338423040 00000100:00100000:3.0:1787393039.727215:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787393039.727221:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338423040:12345-0@lo:400: 00000100:00100000:3.0:1787393039.727251:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338423040:12345-0@lo:400: Request processed in 30us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393039.727257:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787393039.727277:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787393039.727281:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787393039.727306:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de835328000 x1874217338422912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393039.727321:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338422912:0@lo:400: 00010000:00080000:3.0:1787393039.727331:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83532b100 x1874217338422784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393039.727342:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338422784:0@lo:400: 00010000:00080000:3.0:1787393039.727370:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83532bb80 x1874217338423040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393039.727378:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338423040:0@lo:400: 00000100:00100000:3.0:1787393039.727386:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338422656:0@lo:400: 00010000:00080000:3.0:1787393039.727395:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83532a300 x1874217338423168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393039.727402:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338423168:0@lo:400: 00010000:00010000:0.0:1787393039.848065:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393040.747234:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338423296:0@lo:13: 00000100:00100000:3.0:1787393040.747317:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:02000400:1.0:1787393040.749782:0:7865:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787393040.749901:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338423296 00000100:00100000:0.0:1787393040.749910:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338423296 00000100:00100000:0.0:1787393040.749971:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787393040.749980:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338423296:12345-0@lo:13: 00002000:00000024:0.0:1787393040.750016:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393040.754631:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338423296:12345-0@lo:13: Request processed in 4644us (7306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393040.754644:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787393040.755170:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83c63d180 x1874217338423296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393040.755195:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338423296:0@lo:13: 00010000:00010000:3.0:1787393040.872046:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787393041.256479:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787393041.256487:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9de83d423000 from 30 10000000:01000000:0.0:1787393041.256492:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787393041.256537:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f12a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.256560:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f12a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.256571:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f12a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393041.256597:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338423424:0@lo:101: 00000100:00100000:0.0:1787393041.256666:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393041.256735:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb59600 going to sleep for 11 seconds 00000100:00100000:2.0:1787393041.256742:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338423424 00000100:00100000:2.0:1787393041.256750:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338423424 00000100:00100000:2.0:1787393041.256805:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787393041.256814:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+13:5818:x1874217338423424:12345-0@lo:101: 00010000:00010000:2.0:1787393041.256853:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393041.256865:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8029e3c00/0x19a927d9c62f12a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f12a1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393041.256886:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8029e3c00/0x19a927d9c62f12a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f12a1 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393041.256895:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8029e3c00/0x19a927d9c62f12a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f12a1 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393041.256904:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8029e3c00, rc 0) 00000100:00100000:2.0:1787393041.256941:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+14:5818:x1874217338423424:12345-0@lo:101: Request processed in 129us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393041.256958:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787393041.257212:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338423424:0@lo:101: 00010000:00010000:0.0:1787393041.257225:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f12a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f12a8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.257233:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f12a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f12a8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393041.257281:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338423552:0@lo:501: 00000100:00100000:0.0:1787393041.257306:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393041.257328:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb59600 going to sleep for 11 seconds 00000100:00100000:2.0:1787393041.257371:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338423552 00000100:00100000:2.0:1787393041.257386:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338423552 00000100:00100000:2.0:1787393041.257416:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787393041.257423:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+14:5818:x1874217338423552:12345-0@lo:501: 00000100:00100000:2.0:1787393041.257749:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+14:5818:x1874217338423552:12345-0@lo:501: Request processed in 325us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393041.257756:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787393041.258091:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338423552:0@lo:501: 00000100:00100000:0.0:1787393041.258132:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338423680:0@lo:503: 00000100:00100000:0.0:1787393041.258172:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393041.258199:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb59600 going to sleep for 11 seconds 00000100:00100000:1.0:1787393041.258312:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338423680 00000100:00100000:1.0:1787393041.258317:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338423680 00000100:00100000:1.0:1787393041.258353:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787393041.258360:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:5818:x1874217338423680:12345-0@lo:503: 00000100:00100000:1.0:1787393041.259483:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:5818:x1874217338423680:12345-0@lo:503: Request processed in 1119us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393041.259495:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787393041.266985:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338423680:0@lo:503: 00000100:00100000:1.0:1787393041.284177:0:7889:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:7889:1874217338423808:0@lo:502: 00000100:00100000:1.0:1787393041.284271:0:7889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393041.284314:0:7889:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8181576c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787393041.284448:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338423808 00000100:00100000:0.0:1787393041.284456:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338423808 00000100:00100000:0.0:1787393041.284509:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787393041.284518:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+14:7889:x1874217338423808:12345-0@lo:502: 00000100:00100000:2.0:1787393041.285065:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+14:7889:x1874217338423808:12345-0@lo:502: Request processed in 546us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393041.285084:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787393041.285115:0:7889:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:7889:1874217338423808:0@lo:502: 00000100:00100000:1.0:1787393041.285173:0:7889:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:7889:1874217338423936:0@lo:502: 00000100:00100000:1.0:1787393041.285210:0:7889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393041.285247:0:7889:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8181576c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787393041.288028:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338423936 00000100:00100000:0.0:1787393041.288043:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338423936 00000100:00100000:0.0:1787393041.288116:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787393041.288126:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:7889:x1874217338423936:12345-0@lo:502: 00000100:00100000:0.0:1787393041.288393:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:7889:x1874217338423936:12345-0@lo:502: Request processed in 268us (3182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393041.288402:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787393041.288447:0:7889:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:7889:1874217338423936:0@lo:502: 00000040:00080000:1.0:1787393041.288487:0:7889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787393041.288697:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787393041.288742:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787393041.288766:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f12a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f12a8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.288777:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f12a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f12a8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393041.288786:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787393041.288788:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787393041.288790:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787393041.289041:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8000/0x19a927d9c62f12af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393041.289052:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8040d8000/0x19a927d9c62f12af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393041.289063:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8040d8000/0x19a927d9c62f12af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393041.289084:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338424064:0@lo:101: 00000100:00100000:2.0:1787393041.289208:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393041.289248:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8181576c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787393041.289881:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338424064 00000100:00100000:0.0:1787393041.289898:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338424064 00000100:00100000:0.0:1787393041.289977:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787393041.290044:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+14:5818:x1874217338424064:12345-0@lo:101: 00010000:00010000:1.0:1787393041.290057:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393041.290085:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8040d9000/0x19a927d9c62f12b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f12af expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393041.290149:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8040d9000/0x19a927d9c62f12b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f12af expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393041.290160:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8040d9000/0x19a927d9c62f12b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f12af expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393041.290169:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d9000, rc 0) 00000100:00100000:1.0:1787393041.290235:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338424064:12345-0@lo:101: Request processed in 237us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393041.290258:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338424064:0@lo:101: 00000100:00100000:1.0:1787393041.290259:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00010000:2.0:1787393041.290277:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8040d8000/0x19a927d9c62f12af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f12b6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393041.290288:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8000/0x19a927d9c62f12af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f12b6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393041.290345:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338424192:0@lo:501: 00000100:00100000:2.0:1787393041.290376:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393041.290408:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8082d3780 going to sleep for 11 seconds 00000100:00100000:0.0:1787393041.290930:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338424192 00000100:00100000:0.0:1787393041.290936:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338424192 00000100:00100000:0.0:1787393041.290982:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787393041.290990:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338424192:12345-0@lo:501: 00000100:00100000:0.0:1787393041.291236:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338424192:12345-0@lo:501: Request processed in 247us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393041.291243:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787393041.291651:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338424192:0@lo:501: 00000100:00100000:2.0:1787393041.291697:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338424320:0@lo:503: 00000100:00100000:2.0:1787393041.291742:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393041.291879:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8082d3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787393041.293330:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338424320 00000100:00100000:3.0:1787393041.293341:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338424320 00000100:00100000:3.0:1787393041.293387:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787393041.293395:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338424320:12345-0@lo:503: 00000100:00100000:2.0:1787393041.295520:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338424320:12345-0@lo:503: Request processed in 2118us (3769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393041.295559:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787393041.311215:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338424320:0@lo:503: 00000100:00100000:0.0:1787393041.320281:0:7891:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:7891:1874217338424448:0@lo:502: 00000100:00100000:0.0:1787393041.320360:0:7891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393041.320405:0:7891:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808873240 going to sleep for 11 seconds 00000100:00100000:1.0:1787393041.321302:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338424448 00000100:00100000:1.0:1787393041.321312:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338424448 00000100:00100000:1.0:1787393041.321364:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787393041.321373:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+15:7891:x1874217338424448:12345-0@lo:502: 00000100:00100000:1.0:1787393041.321646:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+15:7891:x1874217338424448:12345-0@lo:502: Request processed in 273us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393041.321653:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787393041.322038:0:7891:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:7891:1874217338424448:0@lo:502: 00000020:01000000:3.0:1787393041.322141:0:7891:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787393041.322151:0:7891:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393041.322154:0:7891:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787393041.322160:0:7891:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787393041.322162:0:7891:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787393041.322188:0:7891:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a81880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:7891:1874217338424576:0@lo:502: 00000100:00100000:3.0:1787393041.322231:0:7891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393041.322259:0:7891:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de701b719c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393041.322964:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338424576 00000100:00100000:1.0:1787393041.322971:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338424576 00000100:00100000:1.0:1787393041.323006:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787393041.323014:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+15:7891:x1874217338424576:12345-0@lo:502: 00000100:00100000:1.0:1787393041.324310:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+15:7891:x1874217338424576:12345-0@lo:502: Request processed in 1291us (2073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393041.324320:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787393041.324737:0:7891:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a81880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:7891:1874217338424576:0@lo:502: 00000020:01000000:3.0:1787393041.324772:0:7891:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787393041.324779:0:7891:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393041.324781:0:7891:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787393041.324785:0:7891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787393041.325019:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787393041.325038:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787393041.325048:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8000/0x19a927d9c62f12af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f12b6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.325059:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8040d8000/0x19a927d9c62f12af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f12b6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393041.325069:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787393041.325071:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9de804ca6000 from 30 10000000:01000000:0.0:1787393041.325085:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787393041.325116:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f12bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.325124:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f12bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.325132:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f12bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393041.325169:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338424704:0@lo:101: 00000100:00100000:0.0:1787393041.325208:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393041.325250:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808873900 going to sleep for 11 seconds 00000100:00100000:1.0:1787393041.325777:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338424704 00000100:00100000:1.0:1787393041.325786:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338424704 00000100:00100000:1.0:1787393041.326876:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787393041.326898:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338424704:12345-0@lo:101: 00010000:00010000:1.0:1787393041.326914:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393041.326931:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8040d9400/0x19a927d9c62f12c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f12bd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393041.326968:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8040d9400/0x19a927d9c62f12c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f12bd expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393041.326979:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8040d9400/0x19a927d9c62f12c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f12bd expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393041.326989:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d9400, rc 0) 00000100:00100000:1.0:1787393041.327051:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338424704:12345-0@lo:101: Request processed in 158us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393041.327059:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787393041.327623:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338424704:0@lo:101: 00010000:00010000:2.0:1787393041.327642:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f12bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f12c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393041.327654:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f12bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f12c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393041.327715:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338424832:0@lo:501: 00000100:00100000:2.0:1787393041.327751:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393041.327789:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8203a8240 going to sleep for 11 seconds 00000100:00100000:3.0:1787393041.327969:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338424832 00000100:00100000:3.0:1787393041.327975:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338424832 00000100:00100000:3.0:1787393041.328011:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787393041.328026:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338424832:12345-0@lo:501: 00000100:00100000:3.0:1787393041.328263:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338424832:12345-0@lo:501: Request processed in 238us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393041.328271:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787393041.328695:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338424832:0@lo:501: 00000100:00100000:2.0:1787393041.328724:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338424960:0@lo:503: 00000100:00100000:2.0:1787393041.328763:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393041.328789:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8203a8240 going to sleep for 11 seconds 00000100:00100000:0.0:1787393041.328884:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338424960 00000100:00100000:0.0:1787393041.328889:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338424960 00000100:00100000:0.0:1787393041.328917:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787393041.328924:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338424960:12345-0@lo:503: 00000100:00100000:0.0:1787393041.329090:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338424960:12345-0@lo:503: Request processed in 164us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393041.329097:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787393041.329283:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338424960:0@lo:503: 00000100:00100000:3.0:1787393041.331472:0:7893:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a81880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:7893:1874217338425088:0@lo:502: 00000100:00100000:3.0:1787393041.331537:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393041.331578:0:7893:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de701b71b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787393041.332002:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338425088 00000100:00100000:0.0:1787393041.332010:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338425088 00000100:00100000:0.0:1787393041.332054:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787393041.332064:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+16:7893:x1874217338425088:12345-0@lo:502: 00000100:00100000:0.0:1787393041.332303:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+16:7893:x1874217338425088:12345-0@lo:502: Request processed in 239us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393041.332311:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787393041.332448:0:7893:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a81880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:7893:1874217338425088:0@lo:502: 00000100:00100000:3.0:1787393041.332500:0:7893:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a81880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:7893:1874217338425216:0@lo:502: 00000100:00100000:3.0:1787393041.332533:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393041.332563:0:7893:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de701b71b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787393041.332613:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338425216 00000100:00100000:1.0:1787393041.332617:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338425216 00000100:00100000:1.0:1787393041.332650:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787393041.332657:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+16:7893:x1874217338425216:12345-0@lo:502: 00000100:00100000:1.0:1787393041.332787:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+16:7893:x1874217338425216:12345-0@lo:502: Request processed in 129us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393041.332794:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787393041.332979:0:7893:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a81880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:7893:1874217338425216:0@lo:502: 00000040:00080000:3.0:1787393041.333000:0:7893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787393041.334013:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787393041.334036:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787393041.334055:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f12bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f12c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393041.334068:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f12bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f12c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393041.334096:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787393041.334098:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9de804ca6000 from 5 10000000:01000000:1.0:1787393041.334102:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787393041.334131:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393041.334140:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393041.334149:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393041.334168:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338425344:0@lo:101: 00000100:00100000:1.0:1787393041.334213:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393041.334252:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de820b9d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787393041.334463:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338425344 00000100:00100000:0.0:1787393041.334470:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338425344 00000100:00100000:0.0:1787393041.334509:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787393041.334517:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338425344:12345-0@lo:101: 00010000:00010000:0.0:1787393041.334527:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393041.334540:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de800030000/0x19a927d9c62f12d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f12cb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.334560:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de800030000/0x19a927d9c62f12d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f12cb expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.334579:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de800030000/0x19a927d9c62f12d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f12cb expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.334587:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800030000, rc 0) 00000100:00100000:0.0:1787393041.334629:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338425344:12345-0@lo:101: Request processed in 112us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393041.334636:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787393041.334737:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338425344:0@lo:101: 00010000:00010000:1.0:1787393041.334750:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f12d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393041.334759:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f12d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393041.334806:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338425472:0@lo:256: 00000100:00100000:1.0:1787393041.335031:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393041.336034:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de820b9d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787393041.341877:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338425472 00000100:00100000:3.0:1787393041.341889:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338425472 00000100:00100000:0.0:1787393041.342004:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787393041.342013:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338425472:12345-0@lo:256: 20000000:01000000:0.0:1787393041.342038:0:5815:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787393041.342055:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787393041.342058:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787393041.342205:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338425472:12345-0@lo:256: Request processed in 192us (7173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393041.342213:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787393041.342342:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338425472:0@lo:256: 10000000:01000000:3.0:1787393041.342400:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787393041.342409:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f12d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393041.342419:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f12d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393041.342427:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787393041.342429:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1787393041.342432:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787393041.342465:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f12d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393041.342473:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f12d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393041.342480:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f12d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393041.342498:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338425600:0@lo:101: 00000100:00100000:3.0:1787393041.342531:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393041.342565:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de701b71b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787393041.343907:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338425600 00000100:00100000:1.0:1787393041.343916:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338425600 00000100:00100000:1.0:1787393041.343972:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787393041.343991:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338425600:12345-0@lo:101: 00010000:00010000:1.0:1787393041.344005:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393041.344019:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f12e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f12d9 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393041.344042:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f12e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f12d9 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393041.344053:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f12e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f12d9 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393041.344062:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d9800, rc 0) 00000100:00100000:1.0:1787393041.344119:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338425600:12345-0@lo:101: Request processed in 130us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393041.344126:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787393041.346282:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338425600:0@lo:101: 00010000:00010000:2.0:1787393041.346307:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f12d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f12e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393041.346319:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f12d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f12e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393041.346392:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338425728:0@lo:501: 00000100:00100000:2.0:1787393041.346441:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393041.346484:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de820044780 going to sleep for 11 seconds 00000100:00100000:1.0:1787393041.346549:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338425728 00000100:00100000:1.0:1787393041.346555:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338425728 00000100:00100000:1.0:1787393041.346599:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787393041.346608:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338425728:12345-0@lo:501: 00000100:00100000:1.0:1787393041.346883:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338425728:12345-0@lo:501: Request processed in 276us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393041.346891:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787393041.347023:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338425728:0@lo:501: 00000100:00100000:2.0:1787393041.347049:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338425856:0@lo:503: 00000100:00100000:2.0:1787393041.347098:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393041.347124:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de820044780 going to sleep for 11 seconds 00000100:00100000:2.0:1787393041.347136:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338425856 00000100:00100000:2.0:1787393041.347139:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338425856 00000100:00100000:2.0:1787393041.347160:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787393041.347166:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338425856:12345-0@lo:503: 00000100:00100000:2.0:1787393041.347435:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338425856:12345-0@lo:503: Request processed in 268us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393041.347443:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787393041.347472:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338425856:0@lo:503: 00000100:00100000:2.0:1787393041.347692:0:7895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:7895:1874217338425984:0@lo:502: 00000100:00100000:2.0:1787393041.347726:0:7895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393041.347743:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338425984 00000100:00100000:2.0:1787393041.347747:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338425984 00000100:00100000:2.0:1787393041.347765:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787393041.347770:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:7895:x1874217338425984:12345-0@lo:502: 00000100:00100000:2.0:1787393041.348022:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:7895:x1874217338425984:12345-0@lo:502: Request processed in 251us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393041.348030:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787393041.348062:0:7895:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de820044b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787393041.348075:0:7895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:7895:1874217338425984:0@lo:502: 00000020:01000000:2.0:1787393041.348094:0:7895:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787393041.348101:0:7895:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787393041.348113:0:7895:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393041.348115:0:7895:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787393041.348123:0:7895:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787393041.348127:0:7895:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.121@tcp to nid 0x20000c0a8cb79 (192.168.203.121@tcp) 00000020:01000000:2.0:1787393041.348148:0:7895:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787393041.348150:0:7895:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787393041.348162:0:7895:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9de83f8019c0) 00000020:00000080:2.0:1787393041.348182:0:7895:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787393041.348187:0:7895:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787393041.348260:0:7895:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787393041.348266:0:7895:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787393041.348273:0:7895:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a927d9c62f12ee 00010000:00080000:2.0:1787393041.348299:0:7895:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9de83f741000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.121@tcp at head 00010000:00010000:2.0:1787393041.348516:0:7895:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787393041.348782:0:7895:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787393041.348792:0:7895:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787393041.349289:0:7895:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787393041.349489:0:7895:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787393041.349539:0:7895:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787393041.349594:0:7895:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787393041.358498:0:7896:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787393041.358507:0:7896:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787393041.360771:0:7895:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787393041.360786:0:7895:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787393041.361024:0:7895:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787393041.361062:0:7895:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a927d9c62f12f5 00000100:00080000:2.0:1787393041.361083:0:7895:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787393041.361090:0:7895:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9de83f741000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:2.0:1787393041.361230:0:7895:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de810335c00 x1874217338426112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787393041.361274:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338426112:0@lo:8: 00000100:00100000:2.0:1787393041.361335:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393041.361386:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338426112 00000100:00100000:2.0:1787393041.361392:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338426112 00000100:00100000:2.0:1787393041.361419:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787393041.361426:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810336300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3323:x1874217338426112:12345-0@lo:8: 00010000:00080000:2.0:1787393041.361450:0:6622:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1787393041.361474:0:6622:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a927d9c62f12fc 00002000:00100000:2.0:1787393041.361487:0:6622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9de82e8b1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787393041.361491:0:6622:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787393041.361495:0:6622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787393041.361610:0:6622:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787393041.361772:0:6622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787393041.361803:0:6622:0:(import.c:65:import_set_state_nolock()) ffff9de83f7dd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787393041.363170:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810336300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3323:x1874217338426112:12345-0@lo:8: Request processed in 1737us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393041.363182:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787393041.363237:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de810335c00 x1874217338426112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787393051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393041.363246:0:3323:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787393041.363254:0:3323:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787393041.363262:0:3323:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787393041.363266:0:3323:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787393041.363269:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de83f741000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787393041.363281:0:3323:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787393041.363296:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338426112:0@lo:8: 00000100:00080000:2.0:1787393041.363322:0:7895:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787393041.363389:0:7895:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787393041.363397:0:7895:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393041.363400:0:7895:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787393041.363403:0:7895:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787393041.363407:0:7895:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393041.363408:0:7895:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787393041.363411:0:7895:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787393041.363413:0:7895:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787393041.363441:0:7895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:7895:1874217338426240:0@lo:502: 00000100:00100000:2.0:1787393041.363487:0:7895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393041.363513:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338426240 00000100:00100000:2.0:1787393041.363517:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338426240 00000100:00100000:2.0:1787393041.363547:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787393041.363555:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:7895:x1874217338426240:12345-0@lo:502: 00000100:00100000:2.0:1787393041.363769:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:7895:x1874217338426240:12345-0@lo:502: Request processed in 214us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393041.363776:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787393041.364659:0:7895:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a1540 going to sleep for 11 seconds 00000100:00100000:2.0:1787393041.364682:0:7895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:7895:1874217338426240:0@lo:502: 00000020:01000000:2.0:1787393041.364708:0:7895:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787393041.364714:0:7895:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393041.364715:0:7895:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787393041.364720:0:7895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787393041.365378:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787393041.365399:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787393041.365409:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f12d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f12e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.365421:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f12d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f12e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393041.365431:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787393041.365434:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9de8180e99c0 from 1 10000000:01000000:0.0:1787393041.365436:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787393041.365465:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1303 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.365484:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1303 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.365493:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1303 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393041.365510:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338426368:0@lo:101: 00000100:00100000:0.0:1787393041.365567:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393041.365597:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80763b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787393041.365614:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338426368 00000100:00100000:0.0:1787393041.365618:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338426368 00000100:00100000:0.0:1787393041.365651:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787393041.365659:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338426368:12345-0@lo:101: 00010000:00010000:0.0:1787393041.365671:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393041.365696:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80761c600/0x19a927d9c62f130a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f1303 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.365718:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761c600/0x19a927d9c62f130a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f1303 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.365728:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80761c600/0x19a927d9c62f130a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1303 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.365736:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761c600, rc 0) 00000100:00100000:0.0:1787393041.365768:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338426368:12345-0@lo:101: Request processed in 109us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393041.365774:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787393041.365810:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338426368:0@lo:101: 00010000:00010000:0.0:1787393041.365853:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1303 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f130a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.365862:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1303 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f130a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393041.365905:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338426496:0@lo:501: 00000100:00100000:0.0:1787393041.365929:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393041.365941:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80763b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787393041.365962:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338426496 00000100:00100000:0.0:1787393041.365965:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338426496 00000100:00100000:0.0:1787393041.365981:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787393041.365987:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338426496:12345-0@lo:501: 00000100:00100000:0.0:1787393041.366342:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338426496:12345-0@lo:501: Request processed in 353us (412us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787393041.366350:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787393041.366383:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338426496:0@lo:501: 10000000:01000000:0.0:1787393041.366401:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787393041.366407:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1303 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f130a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393041.366416:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1303 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f130a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393041.366767:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338426624:0@lo:400: 00000100:00100000:1.0:1787393041.366798:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393041.366832:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787393041.366857:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338427008:0@lo:400: 00000100:00100000:1.0:1787393041.366878:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393041.366901:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338426752:0@lo:400: 00000100:00100000:1.0:1787393041.366933:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393041.366961:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787393041.366967:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338426880:0@lo:400: 00000100:00100000:1.0:1787393041.367016:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787393041.369577:0:7896:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787393041.369723:0:7896:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 190544883166ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787393041.375722:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338426624 00000100:00100000:3.0:1787393041.375737:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338426624 00000100:00100000:3.0:1787393041.375779:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338427008 00000100:00100000:3.0:1787393041.375783:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338427008 00000100:00100000:3.0:1787393041.375807:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338426752 00000100:00100000:3.0:1787393041.375810:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338426752 00000100:00100000:3.0:1787393041.375867:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787393041.375877:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338426624:12345-0@lo:400: 00000100:00100000:3.0:1787393041.375976:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338426624:12345-0@lo:400: Request processed in 99us (9176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393041.375983:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787393041.376010:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787393041.376017:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338427008:12345-0@lo:400: 00000100:00100000:3.0:1787393041.376044:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338427008:12345-0@lo:400: Request processed in 28us (9165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393041.376050:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787393041.376059:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787393041.376073:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338426752:12345-0@lo:400: 00000100:00100000:3.0:1787393041.376121:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338426752:12345-0@lo:400: Request processed in 48us (9186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393041.376127:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787393041.376152:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338426880 00000100:00100000:3.0:1787393041.376155:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338426880 00000100:00100000:3.0:1787393041.376180:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787393041.376186:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338426880:12345-0@lo:400: 00000100:00100000:3.0:1787393041.376215:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338426880:12345-0@lo:400: Request processed in 30us (9198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393041.376221:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787393041.376239:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787393041.376244:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787393041.377632:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83fcc9500 x1874217338426880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393041.377649:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338426880:0@lo:400: 00010000:00080000:1.0:1787393041.377663:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83fcc8700 x1874217338426752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393041.377673:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338426752:0@lo:400: 00010000:00080000:1.0:1787393041.377714:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83fccb800 x1874217338427008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393041.377723:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338427008:0@lo:400: 00010000:00080000:1.0:1787393041.377735:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83fcca680 x1874217338426624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393041.377743:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338426624:0@lo:400: 00000004:00080000:1.0:1787393041.427911:0:7897:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787393041.427940:0:7897:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7897:1874217338427264:0@lo:7: 00000100:00100000:1.0:1787393041.428017:0:7897:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393041.428041:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338427264 00000100:00100000:2.0:1787393041.428049:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338427264 00000100:00100000:1.0:1787393041.428060:0:7897:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de834dda9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393041.428085:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338427136:0@lo:13: 00000100:00100000:2.0:1787393041.428105:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787393041.428110:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393041.428113:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7897:x1874217338427264:12345-0@lo:7: 00000100:00100000:1.0:1787393041.428142:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338427136 00000100:00100000:1.0:1787393041.428145:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338427136 00000100:00100000:1.0:1787393041.428174:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787393041.428179:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3325:x1874217338427136:12345-0@lo:13: 00002000:00000024:1.0:1787393041.428199:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787393041.428238:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3325:x1874217338427136:12345-0@lo:13: Request processed in 58us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393041.428245:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787393041.428284:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83fcca680 x1874217338427136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393041.428302:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338427136:0@lo:13: 00000100:00080000:0.0:1787393041.431057:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1787393041.434508:0:6622:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787393041.434516:0:6622:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787393041.434902:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7897:x1874217338427264:12345-0@lo:7: Request processed in 6786us (6881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393041.434913:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787393041.434961:0:7897:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83fccb800 x1874217338427264/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787393057 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393041.434988:0:7897:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7897:1874217338427264:0@lo:7: 00000004:00080000:0.0:1787393041.435001:0:7897:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787393041.435041:0:7897:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7897:1874217338427392:0@lo:5: 00000100:00100000:0.0:1787393041.435323:0:7897:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393041.435823:0:7897:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83c92a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787393041.436957:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338427392 00000100:00100000:3.0:1787393041.436967:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338427392 00000100:00100000:3.0:1787393041.437009:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787393041.437019:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7897:x1874217338427392:12345-0@lo:5: 00002000:00080000:3.0:1787393041.437046:0:6625:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787393041.437049:0:6625:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787393041.437585:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7897:x1874217338427392:12345-0@lo:5: Request processed in 566us (2260us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787393041.437593:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787393041.437677:0:7897:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83c63df80 x1874217338427392/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787393057 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393041.437692:0:7897:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7897:1874217338427392:0@lo:5: 00000004:00080000:1.0:1787393041.437701:0:7897:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787393041.437729:0:7897:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7897:1874217338427520:0@lo:700: 00000100:00100000:1.0:1787393041.437755:0:7897:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393041.437784:0:7897:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de834ddab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787393041.437788:0:6631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338427520 00000100:00100000:3.0:1787393041.437792:0:6631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338427520 00000100:00100000:3.0:1787393041.437827:0:6631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787393041.437835:0:6631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7897:x1874217338427520:12345-0@lo:700: 00000100:00100000:3.0:1787393041.437885:0:6631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6631:1874217338427648:0@lo:700: 00000100:00100000:3.0:1787393041.437911:0:6631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393041.437936:0:6631:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de701b71cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787393041.438900:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338427648 00000100:00100000:3.0:1787393041.438908:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338427648 00000100:00100000:3.0:1787393041.438961:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787393041.438970:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6631:x1874217338427648:12345-0@lo:700: 00000004:00080000:2.0:1787393041.463682:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1787393041.482444:0:5827:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1787393041.486818:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6631:x1874217338427648:12345-0@lo:700: Request processed in 47841us (48897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393041.486865:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787393041.487016:0:6631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de702a82a00 x1874217338427648/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787393057 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393041.487031:0:6631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6631:1874217338427648:0@lo:700: 40000000:02000000:3.0:1787393041.487044:0:6631:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:3.0:1787393041.541415:0:7527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787393041.541431:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1787393041.541486:0:6631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7897:x1874217338427520:12345-0@lo:700: Request processed in 103647us (103725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393041.541504:0:6631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787393041.541511:0:7897:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83fcca680 x1874217338427520/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787393057 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393041.541526:0:7897:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7897:1874217338427520:0@lo:700: 00000004:02000040:3.0:1787393041.576402:0:7897:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1787393041.580215:0:7897:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a82a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7897:1874217338427776:0@lo:5: 00000100:00100000:3.0:1787393041.580279:0:7897:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393041.580329:0:7897:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de701b710c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393041.580861:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338427776 00000100:00100000:1.0:1787393041.580870:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338427776 00000100:00100000:1.0:1787393041.580922:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787393041.580931:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7897:x1874217338427776:12345-0@lo:5: 00002000:00080000:1.0:1787393041.587576:0:6622:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787393041.587593:0:6622:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787393041.590002:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7897:x1874217338427776:12345-0@lo:5: Request processed in 9065us (9716us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787393041.590013:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787393041.590180:0:7897:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de702a82a00 x1874217338427776/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787393057 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393041.590193:0:7897:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787393041.590206:0:7897:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9de702a82a00 x1874217338427776/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787393057 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393041.590216:0:7897:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a82a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7897:1874217338427776:0@lo:5: 00000004:00080000:3.0:1787393041.590229:0:7897:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1787393041.896011:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393042.921090:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393043.945116:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393044.968397:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787393045.231407:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1787393045.867395:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787393045.867420:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338427904:0@lo:13: 00000100:00100000:0.0:1787393045.867485:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393045.868241:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338427904 00000100:00100000:1.0:1787393045.868252:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338427904 00000100:00100000:1.0:1787393045.868320:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787393045.868330:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338427904:12345-0@lo:13: 00002000:00000024:1.0:1787393045.868363:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393045.868418:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338427904:12345-0@lo:13: Request processed in 89us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393045.868425:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787393045.868463:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83c63ed80 x1874217338427904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393045.868481:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338427904:0@lo:13: 00000100:00080000:0.0:1787393045.868598:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787393045.992208:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393046.378626:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338428032:0@lo:400: 00000100:00100000:1.0:1787393046.378703:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393046.378889:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338428160:0@lo:400: 00000100:00100000:1.0:1787393046.379766:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338428544:0@lo:400: 00000100:00100000:0.0:1787393046.381069:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338428032 00000100:00100000:0.0:1787393046.381080:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338428032 00000100:00100000:2.0:1787393046.381365:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3326:1874217338428416:0@lo:400: 00000100:00100000:1.0:1787393046.381607:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393046.381692:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3325:1874217338428288:0@lo:400: 00000100:00100000:1.0:1787393046.381721:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393046.381760:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338428544 00000100:00100000:1.0:1787393046.381764:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338428544 00000100:00100000:1.0:1787393046.384041:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787393046.384058:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338428544:12345-0@lo:400: 00000100:00100000:1.0:1787393046.384147:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338428544:12345-0@lo:400: Request processed in 94us (2540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393046.384155:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787393046.384208:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de702a81180 x1874217338428544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393046.384238:0:3327:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787393046.384262:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338428544:0@lo:400: 00000100:00080000:1.0:1787393046.384302:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787393046.384325:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338428288 00000100:00100000:1.0:1787393046.384331:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338428288 00000100:00100000:1.0:1787393046.384365:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787393046.384371:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1874217338428288:12345-0@lo:400: 00000100:00100000:1.0:1787393046.384538:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1874217338428288:12345-0@lo:400: Request processed in 166us (2815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393046.384544:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787393046.384559:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787393046.384579:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de702a81f80 x1874217338428288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393046.384590:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3325:1874217338428288:0@lo:400: 00000100:00100000:3.0:1787393046.385005:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393046.385174:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787393046.385184:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3327:x1874217338428032:12345-0@lo:400: 00000100:00100000:0.0:1787393046.385229:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3327:x1874217338428032:12345-0@lo:400: Request processed in 48us (6526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393046.385235:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787393046.385273:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338428032:0@lo:400: 00000100:00100000:1.0:1787393046.385393:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338428160 00000100:00100000:1.0:1787393046.385398:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338428160 00000100:00100000:1.0:1787393046.385430:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787393046.385437:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338428160:12345-0@lo:400: 00000100:00100000:1.0:1787393046.385482:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338428160:12345-0@lo:400: Request processed in 45us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393046.385488:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787393046.385673:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de702a83480 x1874217338428160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393046.385683:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338428160:0@lo:400: 00000100:00100000:2.0:1787393046.386506:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393046.389823:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338428416 00000100:00100000:1.0:1787393046.389854:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338428416 00000100:00100000:1.0:1787393046.389943:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787393046.389954:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1874217338428416:12345-0@lo:400: 00000100:00080000:2.0:1787393046.390154:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393046.390370:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1874217338428416:12345-0@lo:400: Request processed in 418us (3865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393046.390403:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787393046.391942:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de702a83100 x1874217338428416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393046.392327:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3326:1874217338428416:0@lo:400: 00000100:00100000:2.0:1787393046.683025:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393046.683460:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319530880 00000100:00100000:1.0:1787393046.683470:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319530880 00000100:00100000:1.0:1787393046.683962:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 111 00000100:00100000:1.0:1787393046.683972:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2352:x1874217319530880:12345-192.168.203.21@tcp:250: 00010000:00080000:1.0:1787393046.684001:0:5813:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 88a168c4-2b38-4392-a418-7572b035c481@192.168.203.21@tcp t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:1.0:1787393046.684027:0:5813:0:(genops.c:1406:class_connect()) connect: client 88a168c4-2b38-4392-a418-7572b035c481, cookie 0x19a927d9c62f1311 00000100:00080000:1.0:1787393046.684679:0:5813:0:(import.c:65:import_set_state_nolock()) ffff9de834cc5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787393046.685024:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+5:2352:x1874217319530880:12345-192.168.203.21@tcp:250: Request processed in 1051us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393046.685032:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 111 00000100:00100000:3.0:1787393046.693931:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393046.694400:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319530752 00000100:00100000:0.0:1787393046.694410:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319530752 00000100:00100000:0.0:1787393046.694483:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 112 00000100:00100000:0.0:1787393046.694493:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+5:5554:x1874217319530752:12345-192.168.203.21@tcp:101: 00010000:00010000:0.0:1787393046.694515:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393046.694533:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80761dc00/0x19a927d9c62f1318 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d51c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393046.694559:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761dc00/0x19a927d9c62f1318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d51c expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393046.694571:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80761dc00/0x19a927d9c62f1318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d51c expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393046.694580:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761dc00, rc 0) 00000100:00100000:0.0:1787393046.694641:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+6:5554:x1874217319530752:12345-192.168.203.21@tcp:101: Request processed in 149us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393046.694648:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 112 00000100:00100000:3.0:1787393046.697786:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393046.700221:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319531008 00000100:00100000:1.0:1787393046.700235:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319531008 00000100:00100000:1.0:1787393046.701226:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 113 00000100:00100000:1.0:1787393046.701237:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+6:5554:x1874217319531008:12345-192.168.203.21@tcp:501: 00000100:00100000:1.0:1787393046.701633:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+6:5554:x1874217319531008:12345-192.168.203.21@tcp:501: Request processed in 395us (3853us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787393046.701642:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 113 00000100:00100000:3.0:1787393046.704397:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393046.704509:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319531136 00000100:00100000:2.0:1787393046.704518:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319531136 00000100:00100000:2.0:1787393046.704574:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 114 00000100:00100000:2.0:1787393046.704584:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+6:5554:x1874217319531136:12345-192.168.203.21@tcp:101: 00010000:00010000:2.0:1787393046.704599:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393046.704629:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8029e3800/0x19a927d9c62f131f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d523 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393046.704656:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8029e3800/0x19a927d9c62f131f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d523 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393046.704669:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8029e3800/0x19a927d9c62f131f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d523 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393046.704678:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8029e3800, rc 0) 00000100:00100000:2.0:1787393046.704904:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+7:5554:x1874217319531136:12345-192.168.203.21@tcp:101: Request processed in 320us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393046.704921:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 114 00000100:00100000:3.0:1787393046.707158:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393046.707387:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319531264 00000100:00100000:1.0:1787393046.707396:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319531264 00000100:00100000:1.0:1787393046.707453:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 115 00000100:00100000:1.0:1787393046.707462:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+7:5554:x1874217319531264:12345-192.168.203.21@tcp:501: 00000100:00100000:1.0:1787393046.707897:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+8:5554:x1874217319531264:12345-192.168.203.21@tcp:501: Request processed in 433us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393046.707905:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 115 00000100:00100000:3.0:1787393046.709934:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393046.710499:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319531392 00000100:00100000:2.0:1787393046.710509:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319531392 00000100:00100000:2.0:1787393046.710612:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 116 00000100:00100000:2.0:1787393046.710622:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+8:5554:x1874217319531392:12345-192.168.203.21@tcp:503: 00000100:00100000:2.0:1787393046.711104:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+8:5554:x1874217319531392:12345-192.168.203.21@tcp:503: Request processed in 481us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393046.711113:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 116 00000100:00100000:3.0:1787393046.715045:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393046.715396:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319531520 00000100:00100000:1.0:1787393046.715407:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319531520 00000100:00100000:1.0:1787393046.715464:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 117 00000100:00100000:1.0:1787393046.715474:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+8:5573:x1874217319531520:12345-192.168.203.21@tcp:502: 00000100:00100000:1.0:1787393046.715819:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+8:5573:x1874217319531520:12345-192.168.203.21@tcp:502: Request processed in 346us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393046.715827:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 117 00000100:00100000:3.0:1787393046.774102:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393046.775158:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319531648 00000100:00100000:2.0:1787393046.775170:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319531648 00000100:00100000:2.0:1787393046.775233:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 118 00000100:00100000:2.0:1787393046.775243:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+8:5573:x1874217319531648:12345-192.168.203.21@tcp:502: 00000100:00100000:2.0:1787393046.775517:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+8:5573:x1874217319531648:12345-192.168.203.21@tcp:502: Request processed in 274us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393046.775525:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 118 00000100:00100000:3.0:1787393046.782255:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393046.783063:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319531776 00000100:00100000:0.0:1787393046.783075:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319531776 00000100:00100000:0.0:1787393046.783143:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 119 00000100:00100000:0.0:1787393046.783153:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+8:5554:x1874217319531776:12345-192.168.203.21@tcp:101: 00010000:00010000:0.0:1787393046.783169:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393046.783187:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80761c400/0x19a927d9c62f1326 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d54d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393046.783215:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761c400/0x19a927d9c62f1326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d54d expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393046.783226:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80761c400/0x19a927d9c62f1326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d54d expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393046.783261:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761c400, rc 0) 00000100:00100000:0.0:1787393046.783925:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+9:5554:x1874217319531776:12345-192.168.203.21@tcp:101: Request processed in 771us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393046.783933:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 119 00000100:00100000:3.0:1787393046.794676:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393046.795133:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319531904 00000100:00100000:1.0:1787393046.795143:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319531904 00000100:00100000:1.0:1787393046.795246:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 120 00000100:00100000:1.0:1787393046.795258:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+9:5554:x1874217319531904:12345-192.168.203.21@tcp:256: 20000000:01000000:1.0:1787393046.795283:0:5813:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787393046.795307:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787393046.795324:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787393046.795328:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787393046.795330:0:5813:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787393046.798088:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+9:5554:x1874217319531904:12345-192.168.203.21@tcp:256: Request processed in 2814us (3403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393046.798102:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 120 00000100:00100000:3.0:1787393046.812045:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393046.812385:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319532032 00000100:00100000:2.0:1787393046.812412:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319532032 00000100:00100000:2.0:1787393046.812525:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 121 00000100:00100000:2.0:1787393046.812536:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+9:5554:x1874217319532032:12345-192.168.203.21@tcp:101: 00010000:00010000:2.0:1787393046.812553:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393046.812580:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8029e2a00/0x19a927d9c62f132d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d554 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393046.812610:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8029e2a00/0x19a927d9c62f132d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d554 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393046.812620:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8029e2a00/0x19a927d9c62f132d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d554 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393046.812630:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8029e2a00, rc 0) 00000100:00100000:2.0:1787393046.812765:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+10:5554:x1874217319532032:12345-192.168.203.21@tcp:101: Request processed in 231us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393046.812772:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 121 00000100:00100000:3.0:1787393046.816766:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393046.816970:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319532160 00000100:00100000:1.0:1787393046.816984:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319532160 00000100:00100000:1.0:1787393046.817060:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 122 00000100:00100000:1.0:1787393046.817072:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+10:5554:x1874217319532160:12345-192.168.203.21@tcp:501: 00000100:00100000:1.0:1787393046.817506:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+10:5554:x1874217319532160:12345-192.168.203.21@tcp:501: Request processed in 433us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393046.817517:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 122 00000100:00100000:3.0:1787393046.821565:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393046.821726:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319532288 00000100:00100000:2.0:1787393046.821740:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319532288 00000100:00100000:2.0:1787393046.821810:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 123 00000100:00100000:2.0:1787393046.821821:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+10:5554:x1874217319532288:12345-192.168.203.21@tcp:503: 00000100:00100000:2.0:1787393046.822393:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+10:5554:x1874217319532288:12345-192.168.203.21@tcp:503: Request processed in 570us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393046.822403:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 123 00000100:00100000:3.0:1787393046.832837:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393046.833693:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319532416 00000100:00100000:1.0:1787393046.833729:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319532416 00000100:00100000:1.0:1787393046.833816:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 124 00000100:00100000:1.0:1787393046.833829:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+10:5578:x1874217319532416:12345-192.168.203.21@tcp:502: 00000100:00100000:1.0:1787393046.834437:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+10:5578:x1874217319532416:12345-192.168.203.21@tcp:502: Request processed in 605us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393046.834449:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 124 00000100:00100000:2.0:1787393046.838442:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393046.838541:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319532544 00000100:00100000:0.0:1787393046.838551:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319532544 00000100:00100000:0.0:1787393046.838696:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 125 00000100:00100000:0.0:1787393046.838714:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+10:5578:x1874217319532544:12345-192.168.203.21@tcp:502: 00000100:00100000:0.0:1787393046.839021:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+10:5578:x1874217319532544:12345-192.168.203.21@tcp:502: Request processed in 315us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393046.839030:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 125 00000100:00100000:3.0:1787393046.848082:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393046.848199:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319532672 00000100:00100000:1.0:1787393046.848209:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319532672 00000100:00100000:1.0:1787393046.848302:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:1.0:1787393046.848312:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1874217319532672:12345-192.168.203.21@tcp:38: 00010000:00080000:1.0:1787393046.848340:0:5820:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:1.0:1787393046.848385:0:5820:0:(genops.c:1406:class_connect()) connect: client aab0ffcd-9aa3-4dc1-8a02-a1025323dd00, cookie 0x19a927d9c62f1334 00000004:00100000:1.0:1787393046.848412:0:5820:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787393046.848417:0:5820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787393046.874469:0:5820:0:(import.c:65:import_set_state_nolock()) ffff9de83f7db000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787393046.874552:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2352:x1874217319532672:12345-192.168.203.21@tcp:38: Request processed in 26237us (26477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393046.874577:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:1.0:1787393046.888184:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787393046.888482:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338428672:0@lo:13: 00000100:00100000:1.0:1787393046.888551:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393046.889068:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338428672 00000100:00100000:2.0:1787393046.889077:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338428672 00000100:00100000:2.0:1787393046.889166:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787393046.889177:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338428672:12345-0@lo:13: 00002000:00000024:2.0:1787393046.889210:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393046.889267:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338428672:12345-0@lo:13: Request processed in 91us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393046.889274:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787393046.889349:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de702a83b80 x1874217338428672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393046.889368:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338428672:0@lo:13: 00010000:00010000:3.0:1787393047.016228:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393047.884632:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393047.884684:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393047.884893:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319532928 00000100:00100000:1.0:1787393047.884917:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319532928 00000100:00100000:1.0:1787393047.885005:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319532800 00000100:00100000:1.0:1787393047.885009:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319532800 00000100:00100000:1.0:1787393047.885034:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:1.0:1787393047.885045:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:5554:x1874217319532928:12345-192.168.203.21@tcp:41: 00000004:00000024:1.0:1787393047.885123:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:2.0:1787393047.885392:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393047.885547:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:5554:x1874217319532928:12345-192.168.203.21@tcp:41: Request processed in 180us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393047.885558:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:1.0:1787393047.885581:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:1.0:1787393047.885588:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:0:x1874217319532800:12345-192.168.203.21@tcp:41: 00000004:00000024:1.0:1787393047.885603:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787393047.885690:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:0:x1874217319532800:12345-192.168.203.21@tcp:41: Request processed in 102us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393047.885697:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:3.0:1787393047.890996:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393047.891372:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319533056 00000100:00100000:2.0:1787393047.891385:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319533056 00000100:00100000:2.0:1787393047.891460:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:2.0:1787393047.891472:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:5554:x1874217319533056:12345-192.168.203.21@tcp:40: 00000100:00100000:2.0:1787393047.891589:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:5554:x1874217319533056:12345-192.168.203.21@tcp:40: Request processed in 118us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393047.891598:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:2.0:1787393047.899872:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393047.900806:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393047.900869:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393047.901046:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319533440 00000100:00100000:0.0:1787393047.901059:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319533440 00000100:00100000:0.0:1787393047.901127:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:0.0:1787393047.901139:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:5554:x1874217319533440:12345-192.168.203.21@tcp:33: 00000100:00100000:1.0:1787393047.902493:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319533184 00000100:00100000:1.0:1787393047.902507:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319533184 00000100:00100000:1.0:1787393047.902560:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319533312 00000100:00100000:1.0:1787393047.902565:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319533312 00000100:00100000:1.0:1787393047.902593:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:1.0:1787393047.902603:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874217319533184:12345-192.168.203.21@tcp:8: 00010000:00080000:1.0:1787393047.902639:0:6622:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:1.0:1787393047.902683:0:6622:0:(genops.c:1406:class_connect()) connect: client aab0ffcd-9aa3-4dc1-8a02-a1025323dd00, cookie 0x19a927d9c62f133b 00002000:00100000:1.0:1787393047.902699:0:6622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aab0ffcd-9aa3-4dc1-8a02-a1025323dd00/ffff9de834cc7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787393047.902731:0:6622:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787393047.903360:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:2.0:1787393047.903368:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1874217319533312:12345-192.168.203.21@tcp:8: 00010000:00080000:2.0:1787393047.903390:0:7525:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:2.0:1787393047.903414:0:7525:0:(genops.c:1406:class_connect()) connect: client aab0ffcd-9aa3-4dc1-8a02-a1025323dd00, cookie 0x19a927d9c62f1342 00002000:00100000:2.0:1787393047.903421:0:7525:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aab0ffcd-9aa3-4dc1-8a02-a1025323dd00/ffff9de83f7df000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787393047.903428:0:7525:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787393047.903710:0:7525:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787393047.903768:0:7525:0:(import.c:65:import_set_state_nolock()) ffff9de83f7da000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787393047.903888:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2352:x1874217319533312:12345-192.168.203.21@tcp:8: Request processed in 518us (3016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393047.903907:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00002000:00080000:1.0:1787393047.904887:0:6622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787393047.904930:0:6622:0:(import.c:65:import_set_state_nolock()) ffff9de834cc5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787393047.904989:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2352:x1874217319533184:12345-192.168.203.21@tcp:8: Request processed in 2386us (4186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393047.905000:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:1.0:1787393047.907458:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393047.908107:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319533568 00000100:00100000:0.0:1787393047.908121:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319533568 00000100:00100000:0.0:1787393047.908206:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 126 00000100:00100000:0.0:1787393047.908218:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+10:2354:x1874217319533568:12345-192.168.203.21@tcp:400: 00000100:00100000:0.0:1787393047.908318:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+10:2354:x1874217319533568:12345-192.168.203.21@tcp:400: Request processed in 102us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393047.908326:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 126 00000004:00080000:0.0:1787393047.937301:0:5823:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 35857us 00000004:00200000:0.0:1787393047.977497:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787393047.978329:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:5554:x1874217319533440:12345-192.168.203.21@tcp:33: Request processed in 77183us (78498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393047.978344:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00010000:00010000:0.0:1787393048.040083:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393048.284578:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393048.284708:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319533696 00000100:00100000:0.0:1787393048.284721:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319533696 00000100:00100000:0.0:1787393048.284802:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:0.0:1787393048.284814:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:5595:x1874217319533696:12345-192.168.203.21@tcp:101: 00010000:00010000:0.0:1787393048.284879:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393048.288092:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1349 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d57e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393048.288244:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1350 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393048.288258:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1350 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393048.288273:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1350 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393048.289096:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787393048.289103:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787393048.289190:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1350 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393048.289223:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1349 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d57e expref: 8 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393048.289240:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1350 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d57e expref: 7 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393048.289256:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de803da2600) 00010000:00010000:0.0:1787393048.289259:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787393048.289262:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761d000, rc 0) 00000100:00100000:0.0:1787393048.289345:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:5595:x1874217319533696:12345-192.168.203.21@tcp:101: Request processed in 4532us (4781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393048.289352:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00010000:00010000:3.0:1787393049.064639:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787393049.532591:0:6648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00010000:00010000:0.0:1787393050.090599:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393050.727353:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393050.727454:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319533824 00000100:00100000:3.0:1787393050.727463:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319533824 00000100:00080000:2.0:1787393050.727692:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393050.727768:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:3.0:1787393050.727780:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:5648:x1874217319533824:12345-192.168.203.21@tcp:41: 00000004:00000024:3.0:1787393050.727870:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787393050.727951:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:5648:x1874217319533824:12345-192.168.203.21@tcp:41: Request processed in 173us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393050.727958:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:1.0:1787393050.733111:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393050.733236:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319533952 00000100:00100000:3.0:1787393050.733246:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319533952 00000100:00100000:3.0:1787393050.733314:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:3.0:1787393050.733325:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:5648:x1874217319533952:12345-192.168.203.21@tcp:13: 00002000:00000024:3.0:1787393050.733359:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787393050.733422:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:5648:x1874217319533952:12345-192.168.203.21@tcp:13: Request processed in 98us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393050.733429:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00080000:2.0:1787393050.733507:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787393050.735926:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393050.736037:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319534080 00000100:00100000:3.0:1787393050.736046:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319534080 00000100:00100000:3.0:1787393050.736114:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:3.0:1787393050.736123:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:5648:x1874217319534080:12345-192.168.203.21@tcp:13: 00002000:00000024:3.0:1787393050.736156:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787393050.736217:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:5648:x1874217319534080:12345-192.168.203.21@tcp:13: Request processed in 95us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393050.736223:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00080000:2.0:1787393050.738041:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787393050.987033:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787393050.987058:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338428800:0@lo:13: 00000100:00100000:0.0:1787393050.987125:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393050.987435:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338428800 00000100:00100000:1.0:1787393050.987442:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338428800 00000100:00100000:1.0:1787393050.987509:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787393050.987519:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338428800:12345-0@lo:13: 00002000:00000024:1.0:1787393050.987541:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393050.987586:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338428800:12345-0@lo:13: Request processed in 68us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393050.987592:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787393050.987598:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83c63df80 x1874217338428800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393050.987617:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338428800:0@lo:13: 00000100:00080000:3.0:1787393050.987654:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1787393051.087936:0:7527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00010000:00010000:3.0:1787393051.112048:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393051.496061:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338429056:0@lo:400: 00000100:00100000:3.0:1787393051.496136:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393051.496184:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787393051.496189:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338428928:0@lo:400: 00000100:00100000:3.0:1787393051.496214:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393051.496228:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338429440:0@lo:400: 00000100:00100000:3.0:1787393051.496244:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393051.496261:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338429184:0@lo:400: 00000100:00100000:3.0:1787393051.496274:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393051.496285:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787393051.496288:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338429312:0@lo:400: 00000100:00100000:3.0:1787393051.496299:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393051.496317:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338429056 00000100:00100000:3.0:1787393051.496324:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338429056 00000100:00100000:3.0:1787393051.496354:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338429184 00000100:00100000:3.0:1787393051.496355:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338429184 00000100:00100000:3.0:1787393051.496369:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338429312 00000100:00100000:3.0:1787393051.496371:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338429312 00000100:00100000:3.0:1787393051.496382:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787393051.496388:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338429056:12345-0@lo:400: 00000100:00100000:3.0:1787393051.496437:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338429056:12345-0@lo:400: Request processed in 48us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393051.496445:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787393051.496461:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787393051.496468:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338429184:12345-0@lo:400: 00000100:00100000:3.0:1787393051.496497:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338429184:12345-0@lo:400: Request processed in 30us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393051.496501:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787393051.496516:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787393051.496519:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338429312:12345-0@lo:400: 00000100:00100000:3.0:1787393051.496540:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338429312:12345-0@lo:400: Request processed in 20us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393051.496546:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787393051.496562:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338429440 00000100:00100000:3.0:1787393051.496565:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338429440 00000100:00100000:3.0:1787393051.496591:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787393051.496597:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338429440:12345-0@lo:400: 00000100:00100000:3.0:1787393051.496620:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338429440:12345-0@lo:400: Request processed in 24us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393051.496624:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787393051.496640:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787393051.496643:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393051.496667:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338429312:0@lo:400: 00000100:00100000:3.0:1787393051.496677:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338429184:0@lo:400: 00010000:00080000:3.0:1787393051.496713:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de702a82a00 x1874217338429440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393051.496721:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338429440:0@lo:400: 00000100:00100000:3.0:1787393051.496727:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338429056:0@lo:400: 00000100:00100000:2.0:1787393051.496827:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338428928 00000100:00100000:2.0:1787393051.496832:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338428928 00000100:00100000:2.0:1787393051.496881:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787393051.496889:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3327:x1874217338428928:12345-0@lo:400: 00000100:00100000:2.0:1787393051.496925:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3327:x1874217338428928:12345-0@lo:400: Request processed in 38us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393051.496932:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787393051.497071:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338428928:0@lo:400: 00000100:00100000:0.0:1787393052.008227:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338429568:0@lo:13: 00000100:00100000:0.0:1787393052.008297:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393052.009213:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338429568 00000100:00100000:3.0:1787393052.009222:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338429568 00000100:00100000:3.0:1787393052.009274:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787393052.009284:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338429568:12345-0@lo:13: 00002000:00000024:3.0:1787393052.009326:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787393052.009395:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338429568:12345-0@lo:13: Request processed in 113us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393052.009402:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787393052.009601:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83532b100 x1874217338429568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393052.009620:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338429568:0@lo:13: 00000001:00100000:2.0:1787393052.093014:0:5842:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00010000:00010000:0.0:1787393052.136345:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393053.014617:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393053.014656:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393053.014687:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393053.014709:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393053.014736:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319534336 00000100:00100000:3.0:1787393053.014745:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319534336 00000100:00100000:3.0:1787393053.014804:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:3.0:1787393053.014815:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2353:x1874217319534336:12345-192.168.203.21@tcp:400: 00000100:00100000:3.0:1787393053.014925:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2353:x1874217319534336:12345-192.168.203.21@tcp:400: Request processed in 111us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393053.014933:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:3.0:1787393053.014960:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319534464 00000100:00100000:3.0:1787393053.014964:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319534464 00000100:00100000:3.0:1787393053.014985:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319534592 00000100:00100000:3.0:1787393053.014988:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319534592 00000100:00100000:3.0:1787393053.015021:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:3.0:1787393053.015027:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2353:x1874217319534464:12345-192.168.203.21@tcp:400: 00000100:00100000:3.0:1787393053.015054:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2353:x1874217319534464:12345-192.168.203.21@tcp:400: Request processed in 28us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393053.015061:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:3.0:1787393053.015072:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:3.0:1787393053.015079:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2353:x1874217319534592:12345-192.168.203.21@tcp:400: 00000100:00100000:3.0:1787393053.015113:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2353:x1874217319534592:12345-192.168.203.21@tcp:400: Request processed in 35us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393053.015120:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00080000:3.0:1787393053.015136:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787393053.015140:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787393053.015143:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393053.015636:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319534208 00000100:00100000:1.0:1787393053.015642:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319534208 00000100:00100000:1.0:1787393053.015682:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 128 00000100:00100000:1.0:1787393053.015690:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+10:2353:x1874217319534208:12345-192.168.203.21@tcp:400: 00000100:00100000:1.0:1787393053.015731:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+10:2353:x1874217319534208:12345-192.168.203.21@tcp:400: Request processed in 42us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393053.015738:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 128 00010000:00010000:3.0:1787393053.160143:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787393053.227213:0:8178:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787393054.184939:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393055.210939:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393056.104007:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787393056.104031:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338429696:0@lo:13: 00000100:00100000:3.0:1787393056.104093:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393056.104143:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338429696 00000100:00100000:3.0:1787393056.104150:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338429696 00000100:00100000:3.0:1787393056.104200:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787393056.104208:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338429696:12345-0@lo:13: 00002000:00000024:3.0:1787393056.104245:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787393056.104296:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338429696:12345-0@lo:13: Request processed in 88us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393056.104303:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787393056.104323:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787393056.104332:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de702a82d80 x1874217338429696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393056.104351:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338429696:0@lo:13: 00010000:00010000:0.0:1787393056.232002:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393056.617874:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338430208:0@lo:400: 00000100:00100000:0.0:1787393056.617948:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393056.618016:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787393056.618023:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338429824:0@lo:400: 00000100:00100000:0.0:1787393056.618051:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393056.618075:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338430336:0@lo:400: 00000100:00100000:0.0:1787393056.618098:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393056.618125:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874217338429952:0@lo:400: 00000100:00100000:0.0:1787393056.618146:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393056.618164:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787393056.618172:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338430080:0@lo:400: 00000100:00100000:0.0:1787393056.618195:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393056.618227:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338430208 00000100:00100000:0.0:1787393056.618235:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338430208 00000100:00100000:0.0:1787393056.618275:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338429952 00000100:00100000:0.0:1787393056.618279:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338429952 00000100:00100000:0.0:1787393056.618293:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338430080 00000100:00100000:0.0:1787393056.618295:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338430080 00000100:00100000:0.0:1787393056.618314:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787393056.618322:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338430208:12345-0@lo:400: 00000100:00100000:0.0:1787393056.618368:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338430208:12345-0@lo:400: Request processed in 47us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.618375:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787393056.618390:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787393056.618396:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1874217338429952:12345-0@lo:400: 00000100:00100000:0.0:1787393056.618427:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1874217338429952:12345-0@lo:400: Request processed in 31us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.618433:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787393056.618452:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787393056.618459:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338430080:12345-0@lo:400: 00000100:00100000:0.0:1787393056.618486:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338430080:12345-0@lo:400: Request processed in 28us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.618492:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787393056.618510:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338429824 00000100:00100000:0.0:1787393056.618513:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338429824 00000100:00100000:0.0:1787393056.618536:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787393056.618543:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338429824:12345-0@lo:400: 00000100:00100000:0.0:1787393056.618571:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338429824:12345-0@lo:400: Request processed in 28us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.618577:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787393056.618620:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338430336 00000100:00100000:0.0:1787393056.618624:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338430336 00000100:00100000:0.0:1787393056.618663:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787393056.618671:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338430336:12345-0@lo:400: 00000100:00100000:0.0:1787393056.618699:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338430336:12345-0@lo:400: Request processed in 31us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.618705:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787393056.618725:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787393056.618730:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393056.618760:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338430080:0@lo:400: 00000100:00100000:0.0:1787393056.618770:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874217338429952:0@lo:400: 00000100:00100000:0.0:1787393056.618793:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338429824:0@lo:400: 00010000:00080000:0.0:1787393056.618804:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83c63ce00 x1874217338430336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393056.618826:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338430336:0@lo:400: 00000100:00100000:0.0:1787393056.618864:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338430208:0@lo:400: 00000020:00000080:2.0:1787393056.693437:0:8327:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffcc241a2a0 00000020:00000080:2.0:1787393056.693452:0:8327:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787393056.693457:0:8327:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787393056.693463:0:8327:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc241c530 20000000:00000080:2.0:1787393056.693470:0:8327:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9de8180bfc00 uarg=0000000000000000 20000000:01000000:2.0:1787393056.693505:0:8327:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787393056.693507:0:8327:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787393056.693510:0:8327:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787393056.693515:0:8327:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787393056.693520:0:8327:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787393056.693534:0:8327:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787393056.693537:0:8327:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787393056.694448:0:8327:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787393056.694452:0:8327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787393056.695262:0:8328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787393056.695695:0:8327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787393056.695784:0:8327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787393056.695824:0:8327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1787393056.695875:0:8327:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787393056.695878:0:8327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787393056.698147:0:8329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787393056.703350:0:8327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787393056.703411:0:8327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787393056.703447:0:8327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1787393056.703476:0:8327:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787393056.703478:0:8327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787393056.706375:0:8330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787393056.707941:0:8327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787393056.708208:0:8327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787393056.708264:0:8327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1787393056.708283:0:8327:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787393056.708285:0:8327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787393056.714259:0:8331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787393056.714795:0:8327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787393056.714875:0:8327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787393056.714926:0:8327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:2.0:1787393056.714940:0:8327:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787393056.714960:0:8327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f1357 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.714990:0:8327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de800030800/0x19a927d9c62f1254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f124d expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.714997:0:8327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de800031800/0x19a927d9c62f127e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1277 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715003:0:8327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de8029e3c00/0x19a927d9c62f12a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f12a1 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715009:0:8327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de8040d9000/0x19a927d9c62f12b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f12af expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715014:0:8327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de8040d9400/0x19a927d9c62f12c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f12bd expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715020:0:8327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f12e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f12d9 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715025:0:8327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de80761c600/0x19a927d9c62f130a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1303 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715033:0:8327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de80761dc00/0x19a927d9c62f1318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d51c expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715040:0:8327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de8029e3800/0x19a927d9c62f131f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d523 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715054:0:8327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f1357 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715088:0:8327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de8029e3800/0x19a927d9c62f131f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d523 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715103:0:8327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de8029e3800/0x19a927d9c62f131f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d523 expref: 9 pid: 5814 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393056.715117:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338430464:192.168.203.21@tcp:104: 00010000:00010000:2.0:1787393056.715223:0:8327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de80761dc00/0x19a927d9c62f1318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d51c expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715231:0:8327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de80761dc00/0x19a927d9c62f1318 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d51c expref: 9 pid: 5815 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393056.715239:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338430592:192.168.203.21@tcp:104: 00010000:00010000:2.0:1787393056.715267:0:8327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de80761c600/0x19a927d9c62f130a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f1303 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715275:0:8327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de80761c600/0x19a927d9c62f130a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f1303 expref: 18 pid: 5814 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393056.715283:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810336a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338430720:0@lo:104: 00000100:00100000:2.0:1787393056.715319:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787393056.715351:0:8327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f12e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f12d9 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715370:0:8327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f12e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f12d9 expref: 18 pid: 5814 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393056.715379:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338430848:0@lo:104: 00000100:00100000:2.0:1787393056.715404:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787393056.715423:0:8327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de8040d9400/0x19a927d9c62f12c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f12bd expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715431:0:8327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de8040d9400/0x19a927d9c62f12c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f12bd expref: 18 pid: 5813 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393056.715439:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338430976:0@lo:104: 00010000:00010000:2.0:1787393056.715461:0:8327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de8040d9000/0x19a927d9c62f12b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f12af expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715468:0:8327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de8040d9000/0x19a927d9c62f12b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f12af expref: 18 pid: 5815 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393056.715475:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338431104:0@lo:104: 00010000:00010000:2.0:1787393056.715495:0:8327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de8029e3c00/0x19a927d9c62f12a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f12a1 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715501:0:8327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de8029e3c00/0x19a927d9c62f12a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f12a1 expref: 18 pid: 5815 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393056.715507:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338431232:0@lo:104: 00010000:00010000:2.0:1787393056.715527:0:8327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de800031800/0x19a927d9c62f127e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f1277 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715546:0:8327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de800031800/0x19a927d9c62f127e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f1277 expref: 18 pid: 5815 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393056.715554:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338431360:0@lo:104: 00010000:00010000:2.0:1787393056.715578:0:8327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de800030800/0x19a927d9c62f1254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f124d expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393056.715585:0:8327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de800030800/0x19a927d9c62f1254 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f124d expref: 18 pid: 5813 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393056.715592:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338431488:0@lo:104: 00000100:00100000:2.0:1787393056.715606:0:8327:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de82d0f5840 going to sleep for 11 seconds 00000100:00100000:0.0:1787393056.715743:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787393056.715761:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393056.715774:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393056.715784:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393056.715791:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393056.715799:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393056.715806:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338430720 00000100:00100000:0.0:1787393056.715811:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338430720 00000100:00100000:0.0:1787393056.715883:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338430848 00000100:00100000:0.0:1787393056.715886:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338430848 00000100:00100000:0.0:1787393056.715899:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338430976 00000100:00100000:0.0:1787393056.715902:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338430976 00000100:00100000:0.0:1787393056.715911:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338431104 00000100:00100000:0.0:1787393056.715912:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338431104 00000100:00100000:0.0:1787393056.715922:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338431232 00000100:00100000:0.0:1787393056.715923:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338431232 00000100:00100000:0.0:1787393056.715932:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338431360 00000100:00100000:0.0:1787393056.715934:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338431360 00000100:00100000:0.0:1787393056.715941:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338431488 00000100:00100000:0.0:1787393056.715943:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338431488 00000100:00100000:0.0:1787393056.715953:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787393056.715960:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810336d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+9:8327:x1874217338430720:12345-0@lo:104: 00010000:00010000:0.0:1787393056.715983:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1303 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f130a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716039:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787393056.716051:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810336d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+9:8327:x1874217338430720:12345-0@lo:104: Request processed in 91us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.716058:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787393056.716075:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787393056.716080:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f76c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+8:8327:x1874217338430848:12345-0@lo:104: 00010000:00010000:0.0:1787393056.716087:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f12d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f12e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716117:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787393056.716122:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f76c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+8:8327:x1874217338430848:12345-0@lo:104: Request processed in 42us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.716127:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787393056.716152:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787393056.716158:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+7:8327:x1874217338430976:12345-0@lo:104: 00010000:00010000:0.0:1787393056.716164:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f12bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f12c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716186:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787393056.716191:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+7:8327:x1874217338430976:12345-0@lo:104: Request processed in 33us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.716196:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787393056.716207:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787393056.716212:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+6:8327:x1874217338431104:12345-0@lo:104: 00010000:00010000:0.0:1787393056.716218:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de8040d8000/0x19a927d9c62f12af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f12b6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716241:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787393056.716250:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+6:8327:x1874217338431104:12345-0@lo:104: Request processed in 38us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.716256:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787393056.716267:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787393056.716272:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+5:8327:x1874217338431232:12345-0@lo:104: 00010000:00010000:0.0:1787393056.716278:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f12a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f12a8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716303:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787393056.716308:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+5:8327:x1874217338431232:12345-0@lo:104: Request processed in 37us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.716313:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787393056.716325:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787393056.716329:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+4:8327:x1874217338431360:12345-0@lo:104: 00010000:00010000:0.0:1787393056.716335:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f127e expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716357:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1787393056.716362:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+4:8327:x1874217338431360:12345-0@lo:104: Request processed in 33us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.716367:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787393056.716377:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787393056.716382:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:8327:x1874217338431488:12345-0@lo:104: 00010000:00010000:0.0:1787393056.716388:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de8029e2e00/0x19a927d9c62f124d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1254 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716407:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1787393056.716417:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:8327:x1874217338431488:12345-0@lo:104: Request processed in 35us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.716422:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787393056.716439:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787393056.716444:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1303 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f130a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716451:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800030c00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1787393056.716455:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1303 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f130a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716463:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f130a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787393056.716470:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f130a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393056.716475:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787393056.716521:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1303 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f130a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716527:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787393056.716545:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1303 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f130a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716551:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1303 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f130a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716563:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787393056.716566:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f12d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f12e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716579:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531600 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1787393056.716582:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f12d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f12e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716588:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f12d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f12e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787393056.716593:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f12d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f12e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393056.716598:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787393056.716609:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f12d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f12e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716614:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787393056.716619:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f12d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f12e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716625:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f12d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f12e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716633:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787393056.716636:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f12bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f12c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716643:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031a00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1787393056.716645:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f12bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f12c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716660:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f12bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f12c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787393056.716667:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f12bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f12c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393056.716672:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787393056.716684:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f12bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f12c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716691:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787393056.716706:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f12bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f12c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716713:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de800031a00/0x19a927d9c62f12bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f12c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716724:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787393056.716727:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8040d8000/0x19a927d9c62f12af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f12b6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716732:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8000 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1787393056.716734:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8000/0x19a927d9c62f12af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f12b6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716740:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8040d8000/0x19a927d9c62f12af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f12b6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787393056.716746:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8000/0x19a927d9c62f12af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f12b6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393056.716756:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787393056.716768:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8040d8000/0x19a927d9c62f12af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f12b6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716774:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787393056.716779:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8000/0x19a927d9c62f12af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f12b6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716786:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8040d8000/0x19a927d9c62f12af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f12b6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716795:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787393056.716797:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f12a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f12a8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716803:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031c00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1787393056.716806:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f12a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f12a8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716812:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f12a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f12a8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787393056.716818:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f12a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f12a8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393056.716823:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787393056.716834:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f12a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f12a8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716871:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787393056.716881:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f12a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f12a8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716887:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de800031c00/0x19a927d9c62f12a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f12a8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716895:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787393056.716898:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f127e expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716904:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8029e3200 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1787393056.716907:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f127e expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716913:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f127e expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787393056.716918:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f127e expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393056.716923:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787393056.716935:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1277 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f127e expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716941:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787393056.716945:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1277 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f127e expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716951:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8029e3200/0x19a927d9c62f1277 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f127e expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716960:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393056.716968:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8029e2e00/0x19a927d9c62f124d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1254 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716973:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8029e2e00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1787393056.716975:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e2e00/0x19a927d9c62f124d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f1254 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.716982:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8029e2e00/0x19a927d9c62f124d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f1254 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787393056.716987:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e2e00/0x19a927d9c62f124d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f1254 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393056.716992:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787393056.717004:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8029e2e00/0x19a927d9c62f124d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1254 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.717010:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787393056.717014:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8029e2e00/0x19a927d9c62f124d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1254 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.717019:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8029e2e00/0x19a927d9c62f124d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1254 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.717032:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393056.717034:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393056.717036:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393056.717045:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393056.717057:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338431616:0@lo:103: 00000100:00100000:0.0:1787393056.717094:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393056.717126:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338432128:0@lo:103: 00000100:00100000:0.0:1787393056.717151:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393056.717172:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787393056.717176:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338431744:0@lo:103: 00000100:00100000:0.0:1787393056.717193:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393056.717207:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338432256:0@lo:103: 00000100:00100000:0.0:1787393056.717223:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393056.717241:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338431872:0@lo:103: 00000100:00100000:0.0:1787393056.717260:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393056.717269:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338432384:0@lo:103: 00000100:00100000:0.0:1787393056.717286:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393056.717295:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787393056.717299:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338432000:0@lo:103: 00000100:00100000:0.0:1787393056.717318:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393056.717340:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338431616 00000100:00100000:0.0:1787393056.717344:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338431616 00010000:00010000:0.0:1787393056.717364:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de80761c600/0x19a927d9c62f130a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1303 expref: 19 pid: 5814 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393056.717380:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338432128 00000100:00100000:0.0:1787393056.717383:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338432128 00010000:00010000:0.0:1787393056.717392:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de8029e3c00/0x19a927d9c62f12a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f12a1 expref: 20 pid: 5815 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393056.717401:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338431744 00000100:00100000:0.0:1787393056.717403:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338431744 00010000:00010000:0.0:1787393056.717411:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f12e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f12d9 expref: 21 pid: 5814 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393056.717419:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338432256 00000100:00100000:0.0:1787393056.717426:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338432256 00010000:00010000:0.0:1787393056.717441:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de800031800/0x19a927d9c62f127e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1277 expref: 22 pid: 5815 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393056.717451:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338431872 00000100:00100000:0.0:1787393056.717454:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338431872 00010000:00010000:0.0:1787393056.717463:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de8040d9400/0x19a927d9c62f12c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f12bd expref: 23 pid: 5813 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393056.717473:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338432384 00000100:00100000:0.0:1787393056.717475:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338432384 00010000:00010000:0.0:1787393056.717485:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de800030800/0x19a927d9c62f1254 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f124d expref: 24 pid: 5813 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393056.717495:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338432000 00000100:00100000:0.0:1787393056.717497:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338432000 00010000:00010000:0.0:1787393056.717506:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de8040d9000/0x19a927d9c62f12b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f12af expref: 25 pid: 5815 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393056.717516:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787393056.717522:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+25:3326:x1874217338431616:12345-0@lo:103: 00010000:00010000:0.0:1787393056.717531:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393056.717536:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de80761c600/0x19a927d9c62f130a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1303 expref: 25 pid: 5814 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.717545:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de80761c600/0x19a927d9c62f130a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f1303 expref: 25 pid: 5814 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.717559:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393056.717587:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+25:3326:x1874217338431616:12345-0@lo:103: Request processed in 65us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.717593:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787393056.717613:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787393056.717620:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+24:3326:x1874217338432128:12345-0@lo:103: 00010000:00010000:0.0:1787393056.717640:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393056.717646:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de8029e3c00/0x19a927d9c62f12a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f12a1 expref: 24 pid: 5815 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.717654:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de8029e3c00/0x19a927d9c62f12a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f12a1 expref: 24 pid: 5815 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.717663:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393056.717684:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+24:3326:x1874217338432128:12345-0@lo:103: Request processed in 65us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.717690:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787393056.717703:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787393056.717708:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+23:3326:x1874217338431744:12345-0@lo:103: 00010000:00010000:0.0:1787393056.717715:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393056.717719:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f12e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f12d9 expref: 23 pid: 5814 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.717727:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f12e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f12d9 expref: 23 pid: 5814 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.717736:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393056.717756:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+23:3326:x1874217338431744:12345-0@lo:103: Request processed in 48us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.717763:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787393056.717773:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787393056.717779:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+22:3326:x1874217338432256:12345-0@lo:103: 00010000:00010000:0.0:1787393056.717786:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393056.717796:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de800031800/0x19a927d9c62f127e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1277 expref: 22 pid: 5815 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.717803:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de800031800/0x19a927d9c62f127e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f1277 expref: 22 pid: 5815 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.717813:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393056.717834:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+22:3326:x1874217338432256:12345-0@lo:103: Request processed in 55us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.717870:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787393056.717883:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787393056.717888:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+21:3324:x1874217338431872:12345-0@lo:103: 00010000:00010000:0.0:1787393056.717895:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393056.717899:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de8040d9400/0x19a927d9c62f12c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f12bd expref: 21 pid: 5813 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.717906:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de8040d9400/0x19a927d9c62f12c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f12bd expref: 21 pid: 5813 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.717914:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393056.717961:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+21:3324:x1874217338431872:12345-0@lo:103: Request processed in 72us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.717966:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787393056.717979:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787393056.717984:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+20:3324:x1874217338432384:12345-0@lo:103: 00010000:00010000:0.0:1787393056.717991:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393056.717994:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de800030800/0x19a927d9c62f1254 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f124d expref: 20 pid: 5813 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.718010:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de800030800/0x19a927d9c62f1254 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f124d expref: 20 pid: 5813 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.718019:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393056.718039:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+20:3324:x1874217338432384:12345-0@lo:103: Request processed in 56us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.718045:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787393056.718056:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787393056.718062:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de826cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338432000:12345-0@lo:103: 00010000:00010000:0.0:1787393056.718068:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393056.718072:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de8040d9000/0x19a927d9c62f12b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f12af expref: 19 pid: 5815 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.718080:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de8040d9000/0x19a927d9c62f12b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f12af expref: 19 pid: 5815 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.718089:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393056.718113:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de826cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338432000:12345-0@lo:103: Request processed in 52us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.718119:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787393056.718308:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338432000:0@lo:103: 00000100:00100000:0.0:1787393056.718317:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338431872:0@lo:103: 00000100:00100000:0.0:1787393056.718323:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338432384:0@lo:103: 00000100:00100000:0.0:1787393056.718350:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338431744:0@lo:103: 00000100:00100000:0.0:1787393056.718356:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338432256:0@lo:103: 00000100:00100000:0.0:1787393056.718370:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338431616:0@lo:103: 00000100:00100000:0.0:1787393056.718378:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338432128:0@lo:103: 00010000:00010000:2.0:1787393056.718685:0:8327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80761c600/0x19a927d9c62f130a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f1303 expref: 18 pid: 5814 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393056.718696:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810336a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338430720:0@lo:104: 00010000:00010000:2.0:1787393056.718707:0:8327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f12e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f12d9 expref: 17 pid: 5814 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393056.718714:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338430848:0@lo:104: 00010000:00010000:2.0:1787393056.718723:0:8327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8040d9400/0x19a927d9c62f12c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f12bd expref: 16 pid: 5813 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393056.718730:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338430976:0@lo:104: 00010000:00010000:2.0:1787393056.718738:0:8327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8040d9000/0x19a927d9c62f12b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f12af expref: 15 pid: 5815 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393056.718745:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338431104:0@lo:104: 00010000:00010000:2.0:1787393056.718762:0:8327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8029e3c00/0x19a927d9c62f12a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f12a1 expref: 14 pid: 5815 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393056.718771:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338431232:0@lo:104: 00010000:00010000:2.0:1787393056.718780:0:8327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de800031800/0x19a927d9c62f127e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f1277 expref: 13 pid: 5815 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393056.718788:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338431360:0@lo:104: 00010000:00010000:2.0:1787393056.718796:0:8327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de800030800/0x19a927d9c62f1254 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f124d expref: 12 pid: 5813 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393056.718804:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338431488:0@lo:104: 00000100:00100000:2.0:1787393056.732697:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393056.732736:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393056.732814:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319534720 00000100:00100000:0.0:1787393056.732822:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319534720 00010000:00010000:0.0:1787393056.732880:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de8029e3800/0x19a927d9c62f131f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d523 expref: 10 pid: 5814 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393056.732908:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319534848 00000100:00100000:0.0:1787393056.732910:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319534848 00010000:00010000:0.0:1787393056.732930:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de80761dc00/0x19a927d9c62f1318 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d51c expref: 11 pid: 5815 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393056.732943:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:0.0:1787393056.732951:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810336680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a168c4-2b38-4392-a418-7572b035c481+11:2353:x1874217319534720:12345-192.168.203.21@tcp:103: 00010000:00010000:0.0:1787393056.732971:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393056.732977:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de8029e3800/0x19a927d9c62f131f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d523 expref: 11 pid: 5814 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.732988:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de8029e3800/0x19a927d9c62f131f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d523 expref: 11 pid: 5814 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.733005:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393056.733049:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810336680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a168c4-2b38-4392-a418-7572b035c481+11:2353:x1874217319534720:12345-192.168.203.21@tcp:103: Request processed in 98us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.733056:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:0.0:1787393056.733073:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:0.0:1787393056.733079:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810336d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a168c4-2b38-4392-a418-7572b035c481+10:2353:x1874217319534848:12345-192.168.203.21@tcp:103: 00010000:00010000:0.0:1787393056.733099:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393056.733104:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de80761dc00/0x19a927d9c62f1318 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d51c expref: 10 pid: 5815 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.733113:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de80761dc00/0x19a927d9c62f1318 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d51c expref: 10 pid: 5815 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.733125:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f1357 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.733132:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f1357 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.733147:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f1357 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.733154:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f1357 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.733161:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f1357 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.733167:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f1357 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.733173:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8029e3600 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393056.733177:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f1357 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.733185:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f1357 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.733204:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f1357 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393056.733214:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393056.733233:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810336d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a168c4-2b38-4392-a418-7572b035c481+10:2353:x1874217319534848:12345-192.168.203.21@tcp:103: Request processed in 154us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393056.733240:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 20 00010000:00010000:1.0:1787393056.735504:0:8327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8029e3800/0x19a927d9c62f131f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d523 expref: 9 pid: 5814 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393056.735537:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338430464:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393056.735573:0:8327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80761dc00/0x19a927d9c62f1318 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d51c expref: 8 pid: 5815 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393056.735581:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8327:1874217338430592:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393056.735624:0:8327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f1357 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393056.735706:0:8327:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f1357 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393056.735721:0:8327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f1357 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393056.735728:0:8327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f1357 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393057.128060:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787393057.128084:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338432512:0@lo:13: 00000100:00100000:3.0:1787393057.128147:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393057.128218:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338432512 00000100:00100000:2.0:1787393057.128236:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338432512 00000100:00100000:2.0:1787393057.128361:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787393057.128371:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338432512:12345-0@lo:13: 00002000:00000024:2.0:1787393057.128408:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393057.128456:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338432512:12345-0@lo:13: Request processed in 87us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393057.128461:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787393057.129670:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de702a81f80 x1874217338432512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393057.129694:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338432512:0@lo:13: 00010000:00010000:0.0:1787393057.256018:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393058.135109:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393058.135193:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393058.135223:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393058.135271:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393058.135315:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319535232 00000100:00100000:3.0:1787393058.135324:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319535232 00000100:00100000:3.0:1787393058.135368:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319535360 00000100:00100000:3.0:1787393058.135371:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319535360 00000100:00100000:3.0:1787393058.135392:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:3.0:1787393058.135401:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2355:x1874217319535232:12345-192.168.203.21@tcp:400: 00000100:00100000:3.0:1787393058.135472:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2355:x1874217319535232:12345-192.168.203.21@tcp:400: Request processed in 72us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393058.135479:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:3.0:1787393058.135494:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:3.0:1787393058.135500:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2355:x1874217319535360:12345-192.168.203.21@tcp:400: 00000100:00100000:3.0:1787393058.135520:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2355:x1874217319535360:12345-192.168.203.21@tcp:400: Request processed in 20us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393058.135535:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:0.0:1787393058.135954:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319535104 00000100:00100000:0.0:1787393058.135960:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319535104 00000100:00100000:0.0:1787393058.136003:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 26 00000100:00100000:0.0:1787393058.136011:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319535104:12345-192.168.203.21@tcp:400: 00000100:00100000:0.0:1787393058.136058:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319535104:12345-192.168.203.21@tcp:400: Request processed in 48us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393058.136065:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 26 00000100:00080000:0.0:1787393058.136083:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787393058.136087:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787393058.136089:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787393058.137191:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319534976 00000100:00100000:2.0:1787393058.137200:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319534976 00000100:00100000:2.0:1787393058.137291:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 130 00000100:00100000:2.0:1787393058.137300:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+8:2355:x1874217319534976:12345-192.168.203.21@tcp:400: 00000100:00100000:2.0:1787393058.137357:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+8:2355:x1874217319534976:12345-192.168.203.21@tcp:400: Request processed in 57us (2255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393058.137374:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 130 00010000:00010000:0.0:1787393058.280509:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787393058.535959:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787393058.535966:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9de834a79800 from 39 10000000:01000000:1.0:1787393058.535972:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787393058.536021:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f135e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393058.536033:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f135e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393058.536043:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f135e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393058.536082:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338432640:0@lo:101: 00000100:00100000:1.0:1787393058.536149:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393058.536504:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338432640 00000100:00100000:0.0:1787393058.536513:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338432640 00000100:00100000:1.0:1787393058.536563:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808313540 going to sleep for 11 seconds 00000100:00100000:0.0:1787393058.540651:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787393058.540675:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+12:5818:x1874217338432640:12345-0@lo:101: 00010000:00010000:0.0:1787393058.540692:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393058.540714:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80761d200/0x19a927d9c62f1365 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f135e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393058.540798:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761d200/0x19a927d9c62f1365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f135e expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393058.540821:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80761d200/0x19a927d9c62f1365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f135e expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393058.540915:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761d200, rc 0) 00000100:00100000:0.0:1787393058.541111:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+13:5818:x1874217338432640:12345-0@lo:101: Request processed in 447us (4961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393058.541118:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787393058.541559:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338432640:0@lo:101: 00010000:00010000:1.0:1787393058.541578:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f135e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1365 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393058.541589:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f135e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f1365 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393058.541655:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338432768:0@lo:501: 00000100:00100000:1.0:1787393058.541691:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393058.541882:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808313540 going to sleep for 11 seconds 00000100:00100000:2.0:1787393058.541945:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338432768 00000100:00100000:2.0:1787393058.541951:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338432768 00000100:00100000:2.0:1787393058.542080:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787393058.542089:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+13:5818:x1874217338432768:12345-0@lo:501: 00000100:00100000:2.0:1787393058.542340:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+13:5818:x1874217338432768:12345-0@lo:501: Request processed in 251us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393058.542348:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787393058.542423:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338432768:0@lo:501: 00000100:00100000:1.0:1787393058.542449:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338432896:0@lo:503: 00000100:00100000:1.0:1787393058.542495:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393058.542730:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808313540 going to sleep for 11 seconds 00000100:00100000:3.0:1787393058.542800:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338432896 00000100:00100000:3.0:1787393058.542805:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338432896 00000100:00100000:3.0:1787393058.542858:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787393058.542866:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:5818:x1874217338432896:12345-0@lo:503: 00000100:00100000:3.0:1787393058.543059:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:5818:x1874217338432896:12345-0@lo:503: Request processed in 194us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393058.543066:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787393058.543222:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338432896:0@lo:503: 00000100:00100000:2.0:1787393058.543859:0:8344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8344:1874217338433024:0@lo:502: 00000100:00100000:2.0:1787393058.543908:0:8344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393058.543941:0:8344:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de82d0f5840 going to sleep for 11 seconds 00000100:00100000:3.0:1787393058.544056:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338433024 00000100:00100000:3.0:1787393058.544061:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338433024 00000100:00100000:3.0:1787393058.544096:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787393058.544103:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:8344:x1874217338433024:12345-0@lo:502: 00000100:00100000:3.0:1787393058.544311:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:8344:x1874217338433024:12345-0@lo:502: Request processed in 208us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393058.544318:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787393058.544569:0:8344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8344:1874217338433024:0@lo:502: 00000100:00100000:1.0:1787393058.544612:0:8344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8344:1874217338433152:0@lo:502: 00000100:00100000:1.0:1787393058.544645:0:8344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393058.544666:0:8344:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808313540 going to sleep for 11 seconds 00000100:00100000:3.0:1787393058.544707:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338433152 00000100:00100000:3.0:1787393058.544711:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338433152 00000100:00100000:3.0:1787393058.544737:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787393058.544742:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:8344:x1874217338433152:12345-0@lo:502: 00000100:00100000:3.0:1787393058.544909:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:8344:x1874217338433152:12345-0@lo:502: Request processed in 165us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393058.544915:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787393058.545102:0:8344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8344:1874217338433152:0@lo:502: 00000040:00080000:1.0:1787393058.545130:0:8344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787393058.545645:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787393058.545664:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787393058.545674:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f135e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1365 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.545684:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f135e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1365 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393058.545693:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787393058.545695:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787393058.545697:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787393058.545724:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2600/0x19a927d9c62f136c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.545731:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8029e2600/0x19a927d9c62f136c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.545750:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8029e2600/0x19a927d9c62f136c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393058.545764:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338433280:0@lo:101: 00000100:00100000:2.0:1787393058.545800:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393058.546068:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338433280 00000100:00100000:3.0:1787393058.546074:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338433280 00000100:00100000:2.0:1787393058.546297:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787393058.546363:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787393058.546372:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+13:5818:x1874217338433280:12345-0@lo:101: 00010000:00010000:3.0:1787393058.546491:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393058.546505:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de801530000/0x19a927d9c62f1373 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f136c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393058.546526:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de801530000/0x19a927d9c62f1373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f136c expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393058.546535:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de801530000/0x19a927d9c62f1373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f136c expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393058.546543:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530000, rc 0) 00000100:00100000:3.0:1787393058.546586:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+14:5818:x1874217338433280:12345-0@lo:101: Request processed in 215us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393058.546593:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787393058.546674:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338433280:0@lo:101: 00010000:00010000:2.0:1787393058.546686:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8029e2600/0x19a927d9c62f136c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1373 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.546694:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8029e2600/0x19a927d9c62f136c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f1373 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393058.546736:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338433408:0@lo:501: 00000100:00100000:2.0:1787393058.546763:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393058.546860:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787393058.550139:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338433408 00000100:00100000:0.0:1787393058.550153:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338433408 00000100:00100000:0.0:1787393058.550258:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787393058.550268:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+14:5818:x1874217338433408:12345-0@lo:501: 00000100:00100000:0.0:1787393058.550591:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+14:5818:x1874217338433408:12345-0@lo:501: Request processed in 324us (3826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393058.550598:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787393058.550673:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338433408:0@lo:501: 00000100:00100000:1.0:1787393058.550718:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338433536:0@lo:503: 00000100:00100000:1.0:1787393058.550764:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393058.553714:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808313540 going to sleep for 11 seconds 00000100:00100000:2.0:1787393058.557226:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338433536 00000100:00100000:2.0:1787393058.557241:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338433536 00000100:00100000:2.0:1787393058.557302:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787393058.557311:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:5818:x1874217338433536:12345-0@lo:503: 00000100:00100000:2.0:1787393058.557575:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:5818:x1874217338433536:12345-0@lo:503: Request processed in 265us (6810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393058.557583:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787393058.557651:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338433536:0@lo:503: 00000100:00100000:2.0:1787393058.558535:0:8345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8345:1874217338433664:0@lo:502: 00000100:00100000:2.0:1787393058.558594:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393058.558634:0:8345:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978480 going to sleep for 11 seconds 00000100:00100000:1.0:1787393058.558823:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338433664 00000100:00100000:1.0:1787393058.558838:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338433664 00000100:00100000:1.0:1787393058.558891:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787393058.558899:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:8345:x1874217338433664:12345-0@lo:502: 00000100:00100000:1.0:1787393058.559607:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:8345:x1874217338433664:12345-0@lo:502: Request processed in 707us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393058.559616:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787393058.559810:0:8345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8345:1874217338433664:0@lo:502: 00000020:01000000:2.0:1787393058.560016:0:8345:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787393058.560025:0:8345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393058.560028:0:8345:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787393058.560033:0:8345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787393058.560069:0:8345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8345:1874217338433792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787393058.560111:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393058.560143:0:8345:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978480 going to sleep for 11 seconds 00000100:00100000:1.0:1787393058.560200:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338433792 00000100:00100000:1.0:1787393058.560206:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338433792 00000100:00100000:1.0:1787393058.560229:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787393058.560235:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:8345:x1874217338433792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393058.560488:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:8345:x1874217338433792:12345-0@lo:502:llog_process_th.0 Request processed in 251us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393058.560495:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787393058.560791:0:8345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8345:1874217338433792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787393058.560814:0:8345:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787393058.560819:0:8345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393058.560822:0:8345:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787393058.560869:0:8345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787393058.561113:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787393058.561132:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787393058.561142:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2600/0x19a927d9c62f136c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1373 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393058.561161:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8029e2600/0x19a927d9c62f136c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1373 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393058.561177:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787393058.561179:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9de83d423000 from 39 10000000:01000000:1.0:1787393058.561182:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787393058.561206:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393058.561215:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393058.561223:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393058.561237:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338433920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787393058.561279:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393058.561535:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808313c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787393058.561577:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338433920 00000100:00100000:0.0:1787393058.561582:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338433920 00000100:00100000:0.0:1787393058.561615:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787393058.561622:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+14:5818:x1874217338433920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787393058.561631:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393058.561643:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80761d800/0x19a927d9c62f1381 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f137a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393058.561674:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761d800/0x19a927d9c62f1381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f137a expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393058.561689:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80761d800/0x19a927d9c62f1381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f137a expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393058.561697:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761d800, rc 0) 00000100:00100000:0.0:1787393058.562005:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338433920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 383us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393058.562013:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787393058.562588:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338433920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787393058.562604:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1381 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.562613:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f1381 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393058.562673:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338434048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787393058.562706:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393058.562779:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787393058.563094:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338434048 00000100:00100000:3.0:1787393058.563100:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338434048 00000100:00100000:3.0:1787393058.563140:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787393058.563156:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338434048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787393058.563678:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338434048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 530us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393058.563686:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787393058.563779:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338434048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787393058.563811:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338434176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787393058.563971:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393058.563998:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787393058.564131:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338434176 00000100:00100000:1.0:1787393058.564135:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338434176 00000100:00100000:1.0:1787393058.564164:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787393058.564170:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338434176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787393058.564541:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338434176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 370us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393058.564548:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787393058.564650:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338434176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787393058.565050:0:8346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8346:1874217338434304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787393058.565098:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393058.565134:0:8346:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978000 going to sleep for 11 seconds 00000100:00100000:1.0:1787393058.565240:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338434304 00000100:00100000:1.0:1787393058.565245:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338434304 00000100:00100000:1.0:1787393058.565284:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787393058.565300:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+15:8346:x1874217338434304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393058.565776:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+15:8346:x1874217338434304:12345-0@lo:502:llog_process_th.0 Request processed in 483us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393058.565788:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787393058.566135:0:8346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8346:1874217338434304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787393058.566193:0:8346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8346:1874217338434432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787393058.566231:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393058.566270:0:8346:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978000 going to sleep for 11 seconds 00000100:00100000:1.0:1787393058.566558:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338434432 00000100:00100000:1.0:1787393058.566563:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338434432 00000100:00100000:1.0:1787393058.566589:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787393058.566596:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+15:8346:x1874217338434432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393058.566773:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+15:8346:x1874217338434432:12345-0@lo:502:llog_process_th.0 Request processed in 178us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393058.566781:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787393058.567168:0:8346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8346:1874217338434432:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787393058.567192:0:8346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787393058.567566:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787393058.567606:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787393058.567617:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1381 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393058.567628:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1381 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393058.567648:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787393058.567650:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787393058.567653:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787393058.567680:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393058.567688:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393058.567696:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393058.567715:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338434560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787393058.567767:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393058.567801:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb59b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787393058.568055:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338434560 00000100:00100000:2.0:1787393058.568061:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338434560 00000100:00100000:2.0:1787393058.568092:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787393058.568100:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+15:5818:x1874217338434560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787393058.568110:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393058.568122:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f138f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f1388 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.568151:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f138f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f1388 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.568161:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f138f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1388 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.568170:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8029e3000, rc 0) 00000100:00100000:2.0:1787393058.568212:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338434560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393058.568218:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787393058.568287:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338434560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787393058.568308:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f138f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393058.568317:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f138f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393058.568369:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338434688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393058.568394:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393058.568419:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808313c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787393058.568626:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338434688 00000100:00100000:2.0:1787393058.568630:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338434688 00000100:00100000:2.0:1787393058.568656:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787393058.568661:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338434688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787393058.568941:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338434688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393058.568948:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787393058.569194:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338434688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393058.569224:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338434816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787393058.569272:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393058.569306:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808313c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787393058.569584:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338434816 00000100:00100000:3.0:1787393058.569589:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338434816 00000100:00100000:3.0:1787393058.569614:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787393058.569621:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338434816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787393058.569788:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338434816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393058.569795:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787393058.570180:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338434816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787393058.572605:0:8347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8347:1874217338434944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787393058.572688:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393058.572721:0:8347:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978840 going to sleep for 11 seconds 00000100:00100000:3.0:1787393058.572878:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338434944 00000100:00100000:3.0:1787393058.572885:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338434944 00000100:00100000:3.0:1787393058.572930:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787393058.572939:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+16:8347:x1874217338434944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787393058.573163:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+16:8347:x1874217338434944:12345-0@lo:502:llog_process_th.0 Request processed in 224us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393058.573177:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787393058.573308:0:8347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8347:1874217338434944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787393058.573341:0:8347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787393058.573532:0:8347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393058.573534:0:8347:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787393058.573548:0:8347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787393058.573572:0:8347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8347:1874217338435072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393058.573608:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393058.573629:0:8347:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808313c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787393058.573863:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338435072 00000100:00100000:2.0:1787393058.573869:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338435072 00000100:00100000:2.0:1787393058.573893:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787393058.573899:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+16:8347:x1874217338435072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787393058.574042:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+16:8347:x1874217338435072:12345-0@lo:502:llog_process_th.0 Request processed in 142us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393058.574049:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787393058.574203:0:8347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8347:1874217338435072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787393058.574223:0:8347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787393058.574228:0:8347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393058.574230:0:8347:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787393058.574236:0:8347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787393058.575091:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787393058.575113:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787393058.575123:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f138f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.575134:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f138f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393058.575198:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787393058.575202:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9de804ca6000 from 39 10000000:01000000:2.0:1787393058.575205:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787393058.575232:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.575247:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.575411:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393058.575495:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338435200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787393058.575541:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393058.575577:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787393058.575621:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338435200 00000100:00100000:1.0:1787393058.575627:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338435200 00000100:00100000:1.0:1787393058.575696:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787393058.575705:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338435200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787393058.575716:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393058.575727:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8040d8000/0x19a927d9c62f139d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f1396 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393058.575759:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8040d8000/0x19a927d9c62f139d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f1396 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393058.575768:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8040d8000/0x19a927d9c62f139d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1396 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393058.575775:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d8000, rc 0) 00000100:00100000:1.0:1787393058.575834:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338435200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393058.575884:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787393058.575952:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338435200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787393058.575964:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f139d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.575973:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f139d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393058.576020:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338435328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787393058.576043:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393058.578107:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787393058.578242:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338435328 00000100:00100000:1.0:1787393058.578403:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338435328 00000100:00100000:1.0:1787393058.578525:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787393058.578536:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338435328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393058.580596:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338435328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2055us (4544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393058.580608:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787393058.580984:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338435328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787393058.581037:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338435456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787393058.581086:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393058.582902:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787393058.583737:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338435456 00000100:00100000:0.0:1787393058.583756:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338435456 00000100:00100000:0.0:1787393058.583867:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787393058.583877:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338435456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787393058.584098:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338435456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (3011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393058.584105:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787393058.584595:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338435456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787393058.585221:0:8348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8348:1874217338435584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787393058.585286:0:8348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393058.585321:0:8348:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978180 going to sleep for 11 seconds 00000100:00100000:1.0:1787393058.585452:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338435584 00000100:00100000:1.0:1787393058.585458:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338435584 00000100:00100000:1.0:1787393058.585494:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787393058.585503:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:8348:x1874217338435584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393058.585708:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:8348:x1874217338435584:12345-0@lo:502:llog_process_th.0 Request processed in 205us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393058.585715:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787393058.586158:0:8348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8348:1874217338435584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787393058.586201:0:8348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8348:1874217338435712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787393058.586238:0:8348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393058.586275:0:8348:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978180 going to sleep for 11 seconds 00000100:00100000:1.0:1787393058.586577:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338435712 00000100:00100000:1.0:1787393058.586583:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338435712 00000100:00100000:1.0:1787393058.586622:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787393058.586629:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+17:8348:x1874217338435712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393058.586836:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+17:8348:x1874217338435712:12345-0@lo:502:llog_process_th.0 Request processed in 187us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393058.586864:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787393058.589383:0:8348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8348:1874217338435712:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787393058.589594:0:8348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787393058.589760:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787393058.589783:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787393058.589793:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f139d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393058.589815:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f139d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393058.589836:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787393058.589864:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787393058.589867:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787393058.589915:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393058.589927:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393058.589935:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393058.589955:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338435840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787393058.590009:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393058.590046:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808313480 going to sleep for 11 seconds 00000100:00100000:2.0:1787393058.590285:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338435840 00000100:00100000:2.0:1787393058.590299:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338435840 00000100:00100000:2.0:1787393058.590338:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787393058.590532:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338435840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787393058.590545:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393058.590558:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8029e3c00/0x19a927d9c62f13ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f13a4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.590581:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8029e3c00/0x19a927d9c62f13ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f13a4 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.590592:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8029e3c00/0x19a927d9c62f13ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f13a4 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.590600:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8029e3c00, rc 0) 00000100:00100000:2.0:1787393058.590642:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338435840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393058.590649:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787393058.591471:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338435840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787393058.591487:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f13ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393058.591495:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f13ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393058.591550:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338435968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393058.591586:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393058.591628:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808313480 going to sleep for 11 seconds 00000100:00100000:2.0:1787393058.591731:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338435968 00000100:00100000:2.0:1787393058.591736:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338435968 00000100:00100000:2.0:1787393058.591781:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787393058.591789:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338435968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787393058.592045:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338435968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393058.592052:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787393058.592416:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338435968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393058.592512:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338436096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787393058.592551:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393058.592579:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808313480 going to sleep for 11 seconds 00000100:00100000:2.0:1787393058.593299:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338436096 00000100:00100000:2.0:1787393058.593306:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338436096 00000100:00100000:2.0:1787393058.593516:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787393058.593526:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338436096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787393058.594620:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338436096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1089us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393058.594631:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787393058.601169:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338436096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787393058.601864:0:8349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8349:1874217338436224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787393058.601938:0:8349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393058.601978:0:8349:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978840 going to sleep for 11 seconds 00000100:00100000:0.0:1787393058.602162:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338436224 00000100:00100000:0.0:1787393058.602169:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338436224 00000100:00100000:0.0:1787393058.602215:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787393058.602223:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+18:8349:x1874217338436224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787393058.602662:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+18:8349:x1874217338436224:12345-0@lo:502:llog_process_th.0 Request processed in 438us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393058.602671:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787393058.603001:0:8349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8349:1874217338436224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787393058.603029:0:8349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787393058.603037:0:8349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393058.603040:0:8349:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787393058.603045:0:8349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787393058.603067:0:8349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8349:1874217338436352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787393058.603103:0:8349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393058.603136:0:8349:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978840 going to sleep for 11 seconds 00000100:00100000:1.0:1787393058.603177:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338436352 00000100:00100000:1.0:1787393058.603183:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338436352 00000100:00100000:1.0:1787393058.603217:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787393058.603226:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:8349:x1874217338436352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393058.603412:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:8349:x1874217338436352:12345-0@lo:502:llog_process_th.0 Request processed in 187us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393058.603419:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787393058.603583:0:8349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8349:1874217338436352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787393058.603608:0:8349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787393058.603613:0:8349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393058.603614:0:8349:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787393058.603618:0:8349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787393058.603871:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1787393058.603888:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787393058.603898:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f13ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393058.603909:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f13ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393058.603918:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787393058.603921:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9de8180e99c0 from 1 10000000:01000000:3.0:1787393058.603923:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787393058.603948:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de801531400/0x19a927d9c62f13b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393058.603956:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de801531400/0x19a927d9c62f13b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393058.603964:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de801531400/0x19a927d9c62f13b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393058.603978:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338436480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787393058.604010:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393058.604030:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80763b780 going to sleep for 11 seconds 00000100:00100000:2.0:1787393058.604149:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338436480 00000100:00100000:2.0:1787393058.604154:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338436480 00000100:00100000:2.0:1787393058.604179:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787393058.604192:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338436480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787393058.604202:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393058.604215:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f13b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f13b2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.604235:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f13b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f13b2 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.604246:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f13b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f13b2 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393058.604254:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8029e3600, rc 0) 00000100:00100000:2.0:1787393058.604295:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338436480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393058.604302:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787393058.604545:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338436480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787393058.604559:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de801531400/0x19a927d9c62f13b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f13b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393058.604580:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de801531400/0x19a927d9c62f13b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f13b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393058.604622:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338436608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787393058.604648:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393058.604670:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80763b780 going to sleep for 11 seconds 00000100:00100000:1.0:1787393058.604753:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338436608 00000100:00100000:1.0:1787393058.604758:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338436608 00000100:00100000:1.0:1787393058.604776:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787393058.604782:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338436608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393058.605206:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338436608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 423us (556us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787393058.605214:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787393058.605278:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338436608:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787393058.605310:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787393058.605317:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de801531400/0x19a927d9c62f13b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f13b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393058.605325:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de801531400/0x19a927d9c62f13b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f13b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393059.303977:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393059.670273:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393059.670372:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319535488 00000100:00100000:1.0:1787393059.670381:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319535488 00000100:00100000:1.0:1787393059.670434:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 163 00000100:00100000:1.0:1787393059.670444:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+8:5568:x1874217319535488:12345-192.168.203.21@tcp:101: 00010000:00010000:1.0:1787393059.670470:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393059.670487:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8040d9400/0x19a927d9c62f13c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d585 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393059.670531:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8040d9400/0x19a927d9c62f13c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d585 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393059.670542:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8040d9400/0x19a927d9c62f13c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d585 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393059.670551:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d9400, rc 0) 00000100:00100000:1.0:1787393059.670613:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+9:5568:x1874217319535488:12345-192.168.203.21@tcp:101: Request processed in 170us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393059.670620:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 163 00000100:00100000:3.0:1787393059.674953:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393059.675048:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319535616 00000100:00100000:0.0:1787393059.675060:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319535616 00000100:00100000:0.0:1787393059.675120:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 164 00000100:00100000:0.0:1787393059.675130:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+9:5568:x1874217319535616:12345-192.168.203.21@tcp:501: 00000100:00100000:0.0:1787393059.675437:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+9:5568:x1874217319535616:12345-192.168.203.21@tcp:501: Request processed in 308us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393059.675446:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 164 00000100:00100000:0.0:1787393059.679347:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393059.680826:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319535744 00000100:00100000:2.0:1787393059.680901:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319535744 00000100:00100000:2.0:1787393059.681064:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 165 00000100:00100000:2.0:1787393059.681076:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+9:5568:x1874217319535744:12345-192.168.203.21@tcp:503: 00000100:00100000:2.0:1787393059.681326:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+9:5568:x1874217319535744:12345-192.168.203.21@tcp:503: Request processed in 252us (1987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393059.681344:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 165 00000100:00100000:3.0:1787393059.686975:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393059.687066:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319535872 00000100:00100000:1.0:1787393059.687076:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319535872 00000100:00100000:1.0:1787393059.687133:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 166 00000100:00100000:1.0:1787393059.687154:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+9:6048:x1874217319535872:12345-192.168.203.21@tcp:502: 00000100:00100000:1.0:1787393059.687423:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+9:6048:x1874217319535872:12345-192.168.203.21@tcp:502: Request processed in 279us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393059.687430:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 166 00000100:00100000:1.0:1787393059.691515:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393059.691599:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319536000 00000100:00100000:2.0:1787393059.691609:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319536000 00000100:00100000:2.0:1787393059.691662:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 167 00000100:00100000:2.0:1787393059.691671:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+9:6048:x1874217319536000:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787393059.691962:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+9:6048:x1874217319536000:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 291us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393059.691970:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 167 00000100:00100000:2.0:1787393059.699168:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393059.699499:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319536128 00000100:00100000:0.0:1787393059.699575:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319536128 00000100:00100000:0.0:1787393059.699632:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 168 00000100:00100000:0.0:1787393059.699641:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+9:5568:x1874217319536128:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787393059.699657:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393059.699673:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80761ce00/0x19a927d9c62f13c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d58c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393059.699699:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761ce00/0x19a927d9c62f13c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d58c expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393059.699710:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80761ce00/0x19a927d9c62f13c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d58c expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393059.699719:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761ce00, rc 0) 00000100:00100000:0.0:1787393059.699779:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+10:5568:x1874217319536128:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 139us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393059.699786:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 168 00000100:00100000:3.0:1787393059.706483:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393059.706705:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319536256 00000100:00100000:1.0:1787393059.706715:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319536256 00000100:00100000:1.0:1787393059.706770:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 169 00000100:00100000:1.0:1787393059.706780:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+10:5568:x1874217319536256:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393059.707130:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+10:5568:x1874217319536256:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 350us (655us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787393059.707139:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 169 00010000:00010000:0.0:1787393060.329805:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787393060.817602:0:8386:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffee4d0a670 00000020:00000080:2.0:1787393060.817618:0:8386:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787393060.817623:0:8386:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787393060.817631:0:8386:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee4d0c900 20000000:00000080:2.0:1787393060.817638:0:8386:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9de8180bc800 uarg=0000000000000000 20000000:01000000:2.0:1787393060.817673:0:8386:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787393060.817678:0:8386:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787393060.817683:0:8386:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787393060.818709:0:8387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787393060.819090:0:8386:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787393060.824201:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787393060.824248:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787393060.824292:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787393060.824306:0:8386:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787393060.824323:0:8386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f13ce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393060.824339:0:8386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de800031200/0x19a927d9c62f1143 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f113c expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393060.824348:0:8386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de8040d9e00/0x19a927d9c62f11a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f119e expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393060.824362:0:8386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1270 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1269 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393060.824372:0:8386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de8029e2a00/0x19a927d9c62f132d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d554 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393060.824379:0:8386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f13ce lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393060.824414:0:8386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de8029e2a00/0x19a927d9c62f132d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d554 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393060.824428:0:8386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de8029e2a00/0x19a927d9c62f132d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d554 expref: 9 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393060.824442:0:8386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8386:1874217338436736:192.168.203.21@tcp:104: 00010000:00010000:2.0:1787393060.824600:0:8386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1270 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f1269 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393060.824609:0:8386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1270 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f1269 expref: 18 pid: 5814 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393060.824618:0:8386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8386:1874217338436864:0@lo:104: 00000100:00100000:2.0:1787393060.824655:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787393060.824885:0:8386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de8040d9e00/0x19a927d9c62f11a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f119e expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393060.824894:0:8386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de8040d9e00/0x19a927d9c62f11a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f119e expref: 18 pid: 5814 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393060.824913:0:8386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8386:1874217338436992:0@lo:104: 00000100:00100000:2.0:1787393060.824936:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393060.828224:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787393060.828244:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:0.0:1787393060.828253:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338436864 00000100:00100000:3.0:1787393060.828254:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338436992 00000100:00100000:3.0:1787393060.828263:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338436992 00000100:00100000:0.0:1787393060.828263:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338436864 00000100:00100000:0.0:1787393060.828312:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787393060.828324:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810334380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+4:8386:x1874217338436864:12345-0@lo:104: 00010000:00010000:0.0:1787393060.828340:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de8029e3400/0x19a927d9c62f1269 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1270 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393060.828367:0:8386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de800031200/0x19a927d9c62f1143 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f113c expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393060.828382:0:8386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9de800031200/0x19a927d9c62f1143 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f113c expref: 18 pid: 5813 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393060.828396:0:8386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810336a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8386:1874217338437120:0@lo:104: 00000100:00100000:2.0:1787393060.828444:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393060.828455:0:8386:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb59600 going to sleep for 11 seconds 00000100:00100000:2.0:1787393060.828487:0:8386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8386:1874217338436864:0@lo:104: 00010000:00010000:0.0:1787393060.828495:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787393060.828503:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810334380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+4:8386:x1874217338436864:12345-0@lo:104: Request processed in 183us (3848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393060.828511:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1787393060.828553:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787393060.828560:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8029e3400/0x19a927d9c62f1269 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1270 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.828568:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8029e3400 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1787393060.828572:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e3400/0x19a927d9c62f1269 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f1270 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.828581:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8029e3400/0x19a927d9c62f1269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f1270 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393060.828592:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e3400/0x19a927d9c62f1269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f1270 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393060.828598:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787393060.828660:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8029e3400/0x19a927d9c62f1269 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1270 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.828667:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787393060.828699:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8029e3400/0x19a927d9c62f1269 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1270 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.828709:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8029e3400/0x19a927d9c62f1269 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1270 expref: -99 pid: 7511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.828725:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393060.828727:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393060.828729:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393060.828741:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338437248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787393060.828773:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393060.828832:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338437248 00000100:00100000:1.0:1787393060.828836:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338437248 00010000:00010000:1.0:1787393060.828882:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1270 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1269 expref: 19 pid: 5814 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393060.828907:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787393060.828914:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fccb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3326:x1874217338437248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787393060.828924:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393060.828930:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1270 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1269 expref: 19 pid: 5814 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.828951:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1270 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f1269 expref: 19 pid: 5814 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.828971:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1270 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f1269 expref: 19 pid: 5814 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.828984:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393060.829009:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fccb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+18:3326:x1874217338437248:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393060.829015:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787393060.829060:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338437248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787393060.830709:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393060.830740:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319536384 00000100:00100000:0.0:1787393060.830741:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338437120 00000100:00100000:1.0:1787393060.830747:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319536384 00000100:00100000:0.0:1787393060.830749:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338437120 00000100:00100000:0.0:1787393060.830782:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1787393060.830783:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de8029e2a00/0x19a927d9c62f132d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d554 expref: 10 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393060.830794:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+4:8386:x1874217338436992:12345-0@lo:104: 00010000:00010000:0.0:1787393060.830815:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de801531c00/0x19a927d9c62f119e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f11a5 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393060.830825:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:1.0:1787393060.830835:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a168c4-2b38-4392-a418-7572b035c481+10:2355:x1874217319536384:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393060.830877:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393060.830883:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9de8029e2a00/0x19a927d9c62f132d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d554 expref: 10 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.830896:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de8029e2a00/0x19a927d9c62f132d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d554 expref: 10 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.830915:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393060.831249:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a168c4-2b38-4392-a418-7572b035c481+10:2355:x1874217319536384:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 415us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393060.831258:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 22 00010000:00010000:2.0:1787393060.832944:0:8386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8029e2a00/0x19a927d9c62f132d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d554 expref: 9 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393060.832968:0:8386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8386:1874217338436736:192.168.203.21@tcp:104: 00000100:00100000:2.0:1787393060.832981:0:8386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8386:1874217338436992:0@lo:104: 00010000:00010000:0.0:1787393060.835589:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787393060.835608:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+4:8386:x1874217338436992:12345-0@lo:104: Request processed in 4813us (10665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393060.835620:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1787393060.835641:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787393060.835651:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de801531c00/0x19a927d9c62f119e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f11a5 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.835662:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531c00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1787393060.835667:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de801531c00/0x19a927d9c62f119e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f11a5 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.835677:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de801531c00/0x19a927d9c62f119e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f11a5 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393060.835694:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de801531c00/0x19a927d9c62f119e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f11a5 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393060.835700:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787393060.835768:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de801531c00/0x19a927d9c62f119e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f11a5 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.835775:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787393060.835820:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787393060.835822:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de801531c00/0x19a927d9c62f119e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f11a5 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.835831:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de801531c00/0x19a927d9c62f119e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f11a5 expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.835868:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393060.835870:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393060.835872:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393060.835880:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787393060.835895:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338437376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787393060.835907:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810337800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:8386:x1874217338437120:12345-0@lo:104: 00010000:00010000:0.0:1787393060.835920:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de8040d9c00/0x19a927d9c62f113c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1143 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393060.835984:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787393060.835990:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810337800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:8386:x1874217338437120:12345-0@lo:104: Request processed in 162us (7546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393060.835997:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787393060.836144:0:8386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810336a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8386:1874217338437120:0@lo:104: 00010000:00010000:2.0:1787393060.836172:0:8386:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f13ce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393060.836214:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787393060.836266:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787393060.836271:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8040d9c00/0x19a927d9c62f113c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f1143 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.836278:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9c00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1787393060.836281:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d9c00/0x19a927d9c62f113c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f1143 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.836287:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8040d9c00/0x19a927d9c62f113c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f1143 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393060.836295:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d9c00/0x19a927d9c62f113c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f1143 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393060.836299:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787393060.836328:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8040d9c00/0x19a927d9c62f113c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1143 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.836335:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787393060.836356:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8040d9c00/0x19a927d9c62f113c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1143 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.836362:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8040d9c00/0x19a927d9c62f113c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f1143 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.836376:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393060.836378:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393060.836379:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393060.836385:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787393060.836393:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338437504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787393060.836420:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393060.836444:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338437376 00000100:00100000:1.0:1787393060.836451:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338437376 00010000:00010000:1.0:1787393060.836473:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de8040d9e00/0x19a927d9c62f11a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f119e expref: 18 pid: 5814 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393060.836505:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338437504 00000100:00100000:2.0:1787393060.836602:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787393060.836612:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:3326:x1874217338437376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787393060.836622:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393060.836629:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9de8040d9e00/0x19a927d9c62f11a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f119e expref: 18 pid: 5814 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393060.836652:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de8040d9e00/0x19a927d9c62f11a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f119e expref: 18 pid: 5814 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393060.836665:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8040d9e00/0x19a927d9c62f11a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f119e expref: 18 pid: 5814 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393060.836678:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393060.836723:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+17:3326:x1874217338437376:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393060.836732:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787393060.836916:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338437504 00000100:00100000:0.0:1787393060.836957:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338437376:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787393060.837101:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de800031200/0x19a927d9c62f1143 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f113c expref: 17 pid: 5813 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393060.837165:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787393060.837173:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:3325:x1874217338437504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787393060.837182:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393060.837186:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de800031200/0x19a927d9c62f1143 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f113c expref: 17 pid: 5813 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.837196:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de800031200/0x19a927d9c62f1143 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f113c expref: 17 pid: 5813 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.837219:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de800031200/0x19a927d9c62f1143 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f113c expref: 17 pid: 5813 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.837233:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f13ce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.837241:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f13ce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.837254:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f13ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.837262:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f13ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.837269:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f13ce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.837275:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f13ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.837281:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8029e2e00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:1.0:1787393060.837285:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f13ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.837292:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f13ce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.837312:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f13ce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393060.837332:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393060.837365:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+16:3325:x1874217338437504:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393060.837373:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787393060.837415:0:8386:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f13ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393060.837423:0:8386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f13ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393060.837429:0:8386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f13ce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393060.843706:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338437504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787393061.224877:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787393061.224900:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338437632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787393061.224986:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393061.225096:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338437632 00000100:00100000:3.0:1787393061.225105:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338437632 00000100:00100000:3.0:1787393061.225287:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787393061.225298:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338437632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787393061.225330:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787393061.225392:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338437632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393061.225588:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787393061.225618:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8351b5c00 x1874217338437632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393061.225638:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338437632:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787393061.227395:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787393061.317763:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393061.317856:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319536512 00000100:00100000:1.0:1787393061.317866:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319536512 00000100:00100000:1.0:1787393061.317923:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 170 00000100:00100000:1.0:1787393061.317932:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+9:5568:x1874217319536512:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787393061.317948:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393061.317965:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8040d9c00/0x19a927d9c62f13d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d593 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393061.317990:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8040d9c00/0x19a927d9c62f13d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d593 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393061.318001:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8040d9c00/0x19a927d9c62f13d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d593 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393061.318010:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d9c00, rc 0) 00000100:00100000:1.0:1787393061.318074:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+10:5568:x1874217319536512:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 143us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393061.318094:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 170 00000100:00100000:2.0:1787393061.321319:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393061.321419:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319536640 00000100:00100000:1.0:1787393061.321428:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319536640 00000100:00100000:1.0:1787393061.321504:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 171 00000100:00100000:1.0:1787393061.321513:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+10:5568:x1874217319536640:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393061.321822:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+10:5568:x1874217319536640:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 309us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393061.321830:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 171 00000100:00100000:1.0:1787393061.329984:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393061.330228:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319536768 00000100:00100000:0.0:1787393061.330238:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319536768 00000100:00100000:0.0:1787393061.330295:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 172 00000100:00100000:0.0:1787393061.330305:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+10:5568:x1874217319536768:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787393061.330640:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+10:5568:x1874217319536768:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 Request processed in 335us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393061.330648:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 172 00000100:00100000:0.0:1787393061.336152:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393061.336451:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319536896 00000100:00100000:1.0:1787393061.336462:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319536896 00000100:00100000:1.0:1787393061.336516:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 173 00000100:00100000:1.0:1787393061.336526:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+10:6105:x1874217319536896:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787393061.336756:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+10:6105:x1874217319536896:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 230us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393061.336765:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 173 00000100:00100000:0.0:1787393061.348583:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393061.348674:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319537024 00000100:00100000:2.0:1787393061.348683:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319537024 00000100:00100000:2.0:1787393061.348737:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 174 00000100:00100000:2.0:1787393061.348746:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+10:6105:x1874217319537024:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787393061.349928:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+10:6105:x1874217319537024:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 1175us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393061.349940:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 174 00010000:00010000:0.0:1787393061.352885:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393061.736204:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874217338437760:0@lo:400:kworker.0 00000100:00100000:0.0:1787393061.736288:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393061.736355:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787393061.736361:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338437888:0@lo:400:kworker.0 00000100:00100000:0.0:1787393061.736385:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393061.736442:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338437760 00000100:00100000:0.0:1787393061.736449:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338437760 00000100:00100000:0.0:1787393061.736486:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338437888 00000100:00100000:0.0:1787393061.736489:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338437888 00000100:00100000:0.0:1787393061.736514:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787393061.736522:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1874217338437760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393061.736577:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1874217338437760:12345-0@lo:400:kworker.0 Request processed in 55us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393061.736584:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787393061.736599:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787393061.736605:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338437888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393061.736630:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338437888:12345-0@lo:400:kworker.0 Request processed in 26us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393061.736636:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787393061.736654:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393061.736687:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338437888:0@lo:400:kworker.0 00000100:00100000:0.0:1787393061.736698:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874217338437760:0@lo:400:kworker.0 00000100:00100000:3.0:1787393061.736826:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338438144:0@lo:400:kworker.0 00000100:00100000:3.0:1787393061.736893:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393061.736923:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787393061.736931:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338438016:0@lo:400:kworker.0 00000100:00100000:0.0:1787393061.736938:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338438144 00000100:00100000:0.0:1787393061.736944:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338438144 00000100:00100000:3.0:1787393061.736968:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393061.737000:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787393061.737009:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338438144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393061.737010:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338438016 00000100:00100000:3.0:1787393061.737016:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338438016 00000100:00100000:3.0:1787393061.737052:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787393061.737060:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338438144:12345-0@lo:400:kworker.0 Request processed in 52us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393061.737062:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338438016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393061.737072:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787393061.737109:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338438016:12345-0@lo:400:kworker.0 Request processed in 48us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393061.737111:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338438016:0@lo:400:kworker.0 00000100:00100000:3.0:1787393061.737122:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787393061.737132:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83f5a8a80 x1874217338438144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393061.737149:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338438144:0@lo:400:kworker.0 00000100:00080000:1.0:1787393061.737359:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787393061.737363:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:3.0:1787393062.187404:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787393062.187411:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de834a79800 from 4 10000000:01000000:3.0:1787393062.187416:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787393062.187460:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de801531800/0x19a927d9c62f13dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393062.187471:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de801531800/0x19a927d9c62f13dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393062.187482:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de801531800/0x19a927d9c62f13dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393062.187506:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338438272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787393062.187578:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393062.187669:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338438272 00000100:00100000:2.0:1787393062.187684:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338438272 00000100:00100000:2.0:1787393062.187738:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787393062.187750:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338438272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787393062.187765:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393062.187778:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8029e3400/0x19a927d9c62f13e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f13dc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393062.187815:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8029e3400/0x19a927d9c62f13e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f13dc expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393062.187828:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80763b600 going to sleep for 11 seconds 00010000:00010000:2.0:1787393062.187829:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8029e3400/0x19a927d9c62f13e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f13dc expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393062.187874:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8029e3400, rc 0) 00000100:00100000:2.0:1787393062.189609:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338438272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1855us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393062.189619:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787393062.192172:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338438272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787393062.192201:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de801531800/0x19a927d9c62f13dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f13e3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393062.192214:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de801531800/0x19a927d9c62f13dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f13e3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393062.192509:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338438400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787393062.192573:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393062.192753:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80763b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787393062.192860:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338438400 00000100:00100000:0.0:1787393062.192868:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338438400 00000100:00100000:0.0:1787393062.192914:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787393062.192923:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338438400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787393062.193181:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338438400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393062.193189:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787393062.193222:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338438400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787393062.193256:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338438528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787393062.196737:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393062.196792:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80763b600 going to sleep for 11 seconds 00000100:00100000:1.0:1787393062.196881:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338438528 00000100:00100000:1.0:1787393062.196890:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338438528 00000100:00100000:1.0:1787393062.196934:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787393062.196945:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338438528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787393062.197147:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338438528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393062.197156:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787393062.197340:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338438528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787393062.197687:0:8455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8455:1874217338438656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393062.197731:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393062.197759:0:8455:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8082b1840 going to sleep for 11 seconds 00000100:00100000:0.0:1787393062.200279:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338438656 00000100:00100000:0.0:1787393062.200291:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338438656 00000100:00100000:0.0:1787393062.200370:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787393062.200380:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:8455:x1874217338438656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787393062.200593:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:8455:x1874217338438656:12345-0@lo:502:llog_process_th.0 Request processed in 214us (2861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393062.200601:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787393062.200704:0:8455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8455:1874217338438656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787393062.200739:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787393062.200750:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393062.200753:0:8455:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787393062.200762:0:8455:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9de834a79800 00000020:00000080:2.0:1787393062.200765:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787393062.205049:0:8455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8455:1874217338438784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787393062.205132:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393062.205170:0:8455:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808313480 going to sleep for 11 seconds 00000100:00100000:0.0:1787393062.205283:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338438784 00000100:00100000:0.0:1787393062.205291:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338438784 00000100:00100000:0.0:1787393062.205338:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787393062.205347:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:8455:x1874217338438784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787393062.205554:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:8455:x1874217338438784:12345-0@lo:502:llog_process_th.0 Request processed in 208us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393062.205563:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787393062.205953:0:8455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8455:1874217338438784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787393062.205981:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787393062.205989:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393062.205991:0:8455:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787393062.205997:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787393062.206066:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787393062.206081:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787393062.206090:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de801531800/0x19a927d9c62f13dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f13e3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393062.206101:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de801531800/0x19a927d9c62f13dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f13e3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393062.206111:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787393062.206113:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de83d423000 from 4 10000000:01000000:3.0:1787393062.206116:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787393062.206143:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de801530200/0x19a927d9c62f13ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393062.206152:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de801530200/0x19a927d9c62f13ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393062.206161:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de801530200/0x19a927d9c62f13ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393062.206176:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338438912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787393062.206209:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393062.206233:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80763b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787393062.206975:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338438912 00000100:00100000:0.0:1787393062.206983:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338438912 00000100:00100000:0.0:1787393062.207020:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787393062.207036:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338438912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787393062.207049:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393062.207062:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80761de00/0x19a927d9c62f13f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f13ea expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393062.207084:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761de00/0x19a927d9c62f13f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f13ea expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393062.207094:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80761de00/0x19a927d9c62f13f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f13ea expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393062.207102:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761de00, rc 0) 00000100:00100000:0.0:1787393062.207147:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338438912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393062.207154:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787393062.207192:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338438912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787393062.207206:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de801530200/0x19a927d9c62f13ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f13f1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393062.207215:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de801530200/0x19a927d9c62f13ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f13f1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393062.207264:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338439040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787393062.207293:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393062.207315:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8181c5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787393062.207327:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338439040 00000100:00100000:0.0:1787393062.207330:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338439040 00000100:00100000:0.0:1787393062.207351:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787393062.207363:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338439040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787393062.207590:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338439040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393062.207597:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787393062.207634:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338439040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787393062.207661:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338439168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787393062.207697:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393062.207711:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8181c5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787393062.207722:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338439168 00000100:00100000:0.0:1787393062.207726:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338439168 00000100:00100000:0.0:1787393062.207749:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787393062.207755:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338439168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787393062.211046:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338439168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3282us (3339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393062.211061:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787393062.213551:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338439168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787393062.214131:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8457:1874217338439296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787393062.214202:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393062.214240:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338439296 00000100:00100000:3.0:1787393062.214246:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338439296 00000100:00100000:3.0:1787393062.214288:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787393062.214304:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:8457:x1874217338439296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787393062.214510:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:8457:x1874217338439296:12345-0@lo:502:llog_process_th.0 Request processed in 206us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393062.214519:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787393062.214566:0:8457:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8181c5540 going to sleep for 11 seconds 00000100:00100000:3.0:1787393062.214582:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8457:1874217338439296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787393062.214605:0:8457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787393062.214614:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393062.214617:0:8457:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787393062.214626:0:8457:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9de83d423000 00000020:00000080:3.0:1787393062.214628:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787393062.215030:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8457:1874217338439424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787393062.215068:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393062.215084:0:8457:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8181c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787393062.215907:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338439424 00000100:00100000:2.0:1787393062.215918:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338439424 00000100:00100000:2.0:1787393062.216028:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787393062.216035:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:8457:x1874217338439424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787393062.216224:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:8457:x1874217338439424:12345-0@lo:502:llog_process_th.0 Request processed in 189us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393062.216238:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787393062.216911:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8457:1874217338439424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787393062.216949:0:8457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787393062.216957:0:8457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393062.216959:0:8457:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787393062.216966:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787393062.217083:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787393062.217100:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787393062.217110:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de801530200/0x19a927d9c62f13ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f13f1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393062.217121:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de801530200/0x19a927d9c62f13ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f13f1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393062.217131:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787393062.217133:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de804ca6000 from 4 10000000:01000000:2.0:1787393062.217135:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787393062.217163:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f13f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393062.217171:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f13f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393062.217179:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f13f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393062.217197:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810336a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338439552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787393062.217239:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393062.217607:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de701b71300 going to sleep for 11 seconds 00000100:00100000:3.0:1787393062.217767:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338439552 00000100:00100000:3.0:1787393062.217773:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338439552 00000100:00100000:3.0:1787393062.217819:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787393062.217828:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338439552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787393062.217865:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393062.217878:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de801531e00/0x19a927d9c62f13ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f13f8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393062.217914:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de801531e00/0x19a927d9c62f13ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f13f8 expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393062.217924:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de801531e00/0x19a927d9c62f13ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f13f8 expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393062.217957:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531e00, rc 0) 00000100:00100000:3.0:1787393062.218000:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338439552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393062.218008:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787393062.218250:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810336a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338439552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787393062.218264:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f13f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f13ff expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393062.218273:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f13f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f13ff expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393062.218321:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338439680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787393062.218347:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393062.218374:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83fa72900 going to sleep for 11 seconds 00000100:00100000:2.0:1787393062.219596:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338439680 00000100:00100000:2.0:1787393062.219605:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338439680 00000100:00100000:2.0:1787393062.219644:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787393062.219652:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338439680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787393062.219931:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338439680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393062.219945:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787393062.220681:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338439680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787393062.220727:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338439808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787393062.220778:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393062.220822:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83fa72900 going to sleep for 11 seconds 00000100:00100000:0.0:1787393062.220855:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338439808 00000100:00100000:0.0:1787393062.220861:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338439808 00000100:00100000:0.0:1787393062.220898:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787393062.220905:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338439808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787393062.221056:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338439808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393062.221063:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787393062.221104:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338439808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787393062.221297:0:8459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8459:1874217338439936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787393062.221327:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393062.221343:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338439936 00000100:00100000:0.0:1787393062.221346:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338439936 00000100:00100000:0.0:1787393062.221363:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787393062.221368:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:8459:x1874217338439936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393062.224149:0:8459:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83fa72a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787393062.224233:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:8459:x1874217338439936:12345-0@lo:502:llog_process_th.0 Request processed in 2859us (2900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393062.224245:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787393062.227572:0:8459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8459:1874217338439936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787393062.227615:0:8459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787393062.227626:0:8459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393062.227628:0:8459:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787393062.227642:0:8459:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9de804ca6000 00000020:00000080:1.0:1787393062.227645:0:8459:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787393062.228005:0:8459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8459:1874217338440064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393062.228083:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393062.228119:0:8459:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8082b16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787393062.228441:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338440064 00000100:00100000:3.0:1787393062.228448:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338440064 00000100:00100000:3.0:1787393062.228527:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787393062.228536:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:8459:x1874217338440064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787393062.228766:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:8459:x1874217338440064:12345-0@lo:502:llog_process_th.0 Request processed in 231us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393062.228775:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787393062.228873:0:8459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:8459:1874217338440064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787393062.228897:0:8459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787393062.228903:0:8459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393062.228905:0:8459:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787393062.228909:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787393062.229045:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787393062.229063:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787393062.229073:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f13f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f13ff expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393062.229084:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f13f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f13ff expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393062.252768:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787393062.252792:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338440192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787393062.252917:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393062.253050:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338440192 00000100:00100000:3.0:1787393062.253059:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338440192 00000100:00100000:3.0:1787393062.253136:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787393062.253146:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338440192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787393062.253182:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787393062.253228:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338440192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393062.253243:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787393062.254141:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83f75dc00 x1874217338440192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393062.254161:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338440192:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787393062.376433:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393063.258494:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393063.258764:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393063.258817:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393063.258876:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319537152 00000100:00100000:2.0:1787393063.258887:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319537152 00000100:00100000:0.0:1787393063.258899:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393063.258945:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 190 00000100:00100000:0.0:1787393063.258955:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319537408 00000100:00100000:0.0:1787393063.258960:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319537408 00000100:00100000:0.0:1787393063.258999:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319537536 00000100:00100000:0.0:1787393063.259002:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319537536 00000100:00100000:0.0:1787393063.259024:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:0.0:1787393063.259034:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2356:x1874217319537408:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393063.259100:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2356:x1874217319537408:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 68us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393063.259108:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:0.0:1787393063.259125:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:0.0:1787393063.259132:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2355:x1874217319537536:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393063.259158:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2355:x1874217319537536:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 27us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393063.259164:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:2.0:1787393063.259185:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+10:2356:x1874217319537152:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393063.259218:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+10:2356:x1874217319537152:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 39us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393063.259235:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 190 00000100:00080000:0.0:1787393063.259301:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787393063.259306:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787393063.260646:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319537280 00000100:00100000:1.0:1787393063.260655:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319537280 00000100:00100000:1.0:1787393063.260721:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:1.0:1787393063.260730:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319537280:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393063.260810:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319537280:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 78us (2324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393063.260834:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00080000:0.0:1787393063.261866:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787393063.400111:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393064.424534:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393065.448280:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393066.344736:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787393066.344759:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338440320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787393066.344854:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393066.348256:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338440320 00000100:00100000:3.0:1787393066.348271:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338440320 00000100:00100000:3.0:1787393066.348337:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787393066.348348:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338440320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787393066.348394:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787393066.348483:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338440320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (3644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393066.348491:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787393066.348517:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787393066.348540:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8351b4e00 x1874217338440320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393066.348561:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338440320:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787393066.472361:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787393066.803471:0:8686:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1787393066.856740:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787393066.856956:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787393066.856976:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338440576:0@lo:400:kworker.0 00000100:00100000:1.0:1787393066.857001:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338440704:0@lo:400:kworker.0 00000100:00100000:1.0:1787393066.857313:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393066.857396:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787393066.857402:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338440832:0@lo:400:kworker.0 00000100:00100000:1.0:1787393066.857428:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393066.857482:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338441088:0@lo:400:kworker.0 00000100:00100000:0.0:1787393066.857488:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338440704 00000100:00100000:0.0:1787393066.857495:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338440704 00000100:00100000:3.0:1787393066.857511:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393066.857531:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338440448:0@lo:400:kworker.0 00000100:00100000:3.0:1787393066.857560:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393066.857577:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787393066.857580:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787393066.857584:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338440960:0@lo:400:kworker.0 00000100:00100000:0.0:1787393066.857585:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338440704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393066.857604:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393066.857630:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338440832 00000100:00100000:3.0:1787393066.857633:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338440832 00000100:00100000:0.0:1787393066.857635:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338440704:12345-0@lo:400:kworker.0 Request processed in 52us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393066.857651:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787393066.857666:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338440960 00000100:00100000:3.0:1787393066.857669:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338441088 00000100:00100000:0.0:1787393066.857669:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338440960 00000100:00100000:3.0:1787393066.857671:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338441088 00000100:00080000:1.0:1787393066.857692:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787393066.857697:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787393066.857700:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393066.857741:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338440576 00000100:00100000:2.0:1787393066.857745:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338440576 00000100:00100000:2.0:1787393066.857764:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787393066.857783:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338440576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393066.857819:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338440576:12345-0@lo:400:kworker.0 Request processed in 41us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393066.857858:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787393066.857864:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787393066.857865:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338440960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393066.857882:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338440448 00000100:00100000:2.0:1787393066.857899:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338440448 00000100:00100000:0.0:1787393066.857900:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338440960:12345-0@lo:400:kworker.0 Request processed in 36us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393066.857906:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787393066.857925:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787393066.857932:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787393066.857933:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338440832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393066.857938:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338440448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393066.857962:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338440448:12345-0@lo:400:kworker.0 Request processed in 24us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393066.857962:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338440832:12345-0@lo:400:kworker.0 Request processed in 31us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393066.857968:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787393066.858025:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338440576:0@lo:400:kworker.0 00000100:00100000:2.0:1787393066.858093:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338440960:0@lo:400:kworker.0 00000100:00100000:2.0:1787393066.858102:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338440448:0@lo:400:kworker.0 00000100:00100000:0.0:1787393066.858164:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787393066.858358:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8351b6d80 x1874217338440832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393066.858369:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338440832:0@lo:400:kworker.0 00000100:00100000:0.0:1787393066.858379:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338440704:0@lo:400:kworker.0 00000100:00100000:2.0:1787393066.865044:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787393066.865062:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338441088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393066.865163:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338441088:12345-0@lo:400:kworker.0 Request processed in 107us (7650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393066.865171:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787393066.866017:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8351b5f80 x1874217338441088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393066.866034:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338441088:0@lo:400:kworker.0 00000100:00100000:1.0:1787393067.369345:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787393067.369369:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338441216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787393067.369441:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393067.369787:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338441216 00000100:00100000:3.0:1787393067.369809:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338441216 00000100:00100000:3.0:1787393067.369878:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787393067.369887:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338441216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787393067.370027:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787393067.370084:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338441216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 198us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393067.370096:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787393067.370168:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83f75d500 x1874217338441216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393067.370187:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338441216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787393067.496054:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393068.378042:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393068.378102:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393068.378151:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393068.378212:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393068.378254:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319537792 00000100:00100000:0.0:1787393068.378267:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319537792 00000100:00100000:0.0:1787393068.378356:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:0.0:1787393068.378368:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2356:x1874217319537792:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393068.378469:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2356:x1874217319537792:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 103us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393068.378483:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:0.0:1787393068.378513:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319537920 00000100:00100000:0.0:1787393068.378516:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319537920 00000100:00100000:0.0:1787393068.378544:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319538048 00000100:00100000:0.0:1787393068.378547:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319538048 00000100:00100000:0.0:1787393068.378570:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:0.0:1787393068.378577:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2356:x1874217319537920:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393068.378608:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2356:x1874217319537920:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 32us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393068.378615:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:0.0:1787393068.378628:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:0.0:1787393068.378634:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2356:x1874217319538048:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393068.378660:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2356:x1874217319538048:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393068.378666:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00080000:0.0:1787393068.378682:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787393068.378687:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787393068.378690:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787393068.378754:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319537664 00000100:00100000:2.0:1787393068.378770:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319537664 00000100:00100000:2.0:1787393068.378803:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 192 00000100:00100000:2.0:1787393068.378811:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+10:2356:x1874217319537664:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393068.378873:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+10:2356:x1874217319537664:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 63us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393068.378952:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 192 00010000:00010000:1.0:1787393068.522654:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393069.544301:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393070.568727:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393071.469377:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338441344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787393071.469448:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393071.469525:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338441344 00000100:00100000:1.0:1787393071.469533:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338441344 00000100:00100000:1.0:1787393071.469587:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787393071.469598:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338441344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787393071.469635:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393071.469691:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338441344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393071.469712:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787393071.469733:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787393071.469771:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83f5a9180 x1874217338441344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393071.469788:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338441344:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787393071.593162:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787393071.892361:0:8930:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing yml_node 00000100:00100000:0.0:1787393071.978166:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338441472:0@lo:400:kworker.0 00000100:00100000:0.0:1787393071.978259:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393071.978469:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338441984:0@lo:400:kworker.0 00000100:00100000:0.0:1787393071.978611:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393071.978637:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787393071.978644:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338441600:0@lo:400:kworker.0 00000100:00100000:0.0:1787393071.978665:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393071.978681:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338442112:0@lo:400:kworker.0 00000100:00100000:0.0:1787393071.978703:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393071.978745:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338441472 00000100:00100000:0.0:1787393071.978752:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338441472 00000100:00100000:0.0:1787393071.978797:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787393071.978806:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338441472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393071.978884:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338441472:12345-0@lo:400:kworker.0 Request processed in 79us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393071.978891:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787393071.978924:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338441984 00000100:00100000:0.0:1787393071.978927:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338441984 00000100:00100000:0.0:1787393071.978955:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338441600 00000100:00100000:0.0:1787393071.978959:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338441600 00000100:00100000:0.0:1787393071.978973:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787393071.978979:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338441984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393071.979010:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338441984:12345-0@lo:400:kworker.0 Request processed in 31us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393071.979016:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787393071.979028:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787393071.979045:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338441600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393071.979102:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338441600:12345-0@lo:400:kworker.0 Request processed in 57us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393071.979109:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787393071.979130:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338442112 00000100:00100000:0.0:1787393071.979133:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338442112 00000100:00100000:0.0:1787393071.979158:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787393071.979164:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338442112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393071.979189:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338442112:12345-0@lo:400:kworker.0 Request processed in 25us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393071.979195:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787393071.979951:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338441600:0@lo:400:kworker.0 00010000:00080000:0.0:1787393071.979975:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8351b4000 x1874217338442112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393071.979986:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338442112:0@lo:400:kworker.0 00000100:00100000:0.0:1787393071.979997:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338441472:0@lo:400:kworker.0 00000100:00100000:0.0:1787393071.980007:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338441984:0@lo:400:kworker.0 00000100:00100000:3.0:1787393071.980679:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338441728:0@lo:400:kworker.0 00000100:00100000:3.0:1787393071.980745:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393071.980809:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338441856:0@lo:400:kworker.0 00000100:00100000:1.0:1787393071.980859:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787393071.980909:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787393071.980915:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393071.980928:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338441856 00000100:00100000:1.0:1787393071.980934:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338441856 00000100:00100000:1.0:1787393071.980971:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787393071.980979:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338441856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393071.981024:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338441856:12345-0@lo:400:kworker.0 Request processed in 46us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393071.981031:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787393071.981062:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8351b4a80 x1874217338441856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393071.981074:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338441856:0@lo:400:kworker.0 00000100:00100000:0.0:1787393071.988316:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338441728 00000100:00100000:0.0:1787393071.988330:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338441728 00000100:00100000:0.0:1787393071.989010:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787393071.989022:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338441728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393071.989243:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338441728:12345-0@lo:400:kworker.0 Request processed in 223us (8496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393071.989251:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787393071.989788:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787393071.994424:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338441728:0@lo:400:kworker.0 00000100:00100000:0.0:1787393072.490409:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338442240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787393072.490481:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393072.490552:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338442240 00000100:00100000:0.0:1787393072.490559:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338442240 00000100:00100000:0.0:1787393072.490603:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787393072.490612:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338442240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787393072.490646:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393072.490695:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338442240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393072.490702:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787393072.490768:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83c63ce00 x1874217338442240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393072.490787:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338442240:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787393072.621182:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393073.508656:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393073.508710:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393073.508805:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319538304 00000100:00100000:3.0:1787393073.508814:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319538304 00000100:00100000:3.0:1787393073.508920:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00100000:3.0:1787393073.508931:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2353:x1874217319538304:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393073.509017:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2353:x1874217319538304:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 86us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393073.509025:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00080000:1.0:1787393073.509157:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393073.509323:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319538176 00000100:00100000:0.0:1787393073.509329:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319538176 00000100:00100000:0.0:1787393073.509368:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 194 00000100:00100000:0.0:1787393073.509377:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+10:2353:x1874217319538176:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393073.509407:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+10:2353:x1874217319538176:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 32us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393073.509414:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 194 00000100:00100000:0.0:1787393073.516369:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393073.516419:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393073.516543:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319538432 00000100:00100000:1.0:1787393073.516554:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319538432 00000100:00100000:1.0:1787393073.516626:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319538560 00000100:00100000:1.0:1787393073.516630:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319538560 00000100:00100000:1.0:1787393073.516657:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:1.0:1787393073.516683:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2352:x1874217319538432:12345-192.168.203.21@tcp:9:kworker.0 00000020:00000080:1.0:1787393073.516737:0:6622:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f133b 00000100:00080000:1.0:1787393073.516747:0:6622:0:(import.c:65:import_set_state_nolock()) ffff9de834cc5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787393073.516786:0:6622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787393073.517192:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+2:2352:x1874217319538432:12345-192.168.203.21@tcp:9:kworker.0 Request processed in 510us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393073.517201:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:1.0:1787393073.517218:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:1.0:1787393073.517225:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2352:x1874217319538560:12345-192.168.203.21@tcp:9:kworker.0 00000020:00000080:1.0:1787393073.517239:0:6622:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1342 00000100:00080000:1.0:1787393073.517246:0:6622:0:(import.c:65:import_set_state_nolock()) ffff9de83f7da000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787393073.517271:0:6622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787393073.517460:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+2:2352:x1874217319538560:12345-192.168.203.21@tcp:9:kworker.0 Request processed in 235us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393073.517467:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00010000:00010000:1.0:1787393073.517491:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393073.518082:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787393073.518255:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787393073.518261:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787393073.643039:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393074.665433:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787393075.139685:0:6648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00000020:00000080:2.0:1787393075.139695:0:6648:0:(genops.c:906:class_export_put()) final put ffff9de834cc7800/aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00000020:00000080:1.0:1787393075.139773:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de834cc7800/aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 for lustre-OST0000 00000020:00000080:1.0:1787393075.139832:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de834cc5800 for lustre-OST0000 00010000:00010000:1.0:1787393075.689064:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787393076.013600:0:9123:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.109 00000100:00100000:1.0:1787393076.585532:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338442368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787393076.585620:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393076.585717:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338442368 00000100:00100000:1.0:1787393076.585727:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338442368 00000100:00100000:1.0:1787393076.585794:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787393076.585805:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338442368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787393076.585886:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393076.585943:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338442368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393076.585952:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787393076.585980:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787393076.586030:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83f5a8000 x1874217338442368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393076.586052:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338442368:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787393076.662238:0:7527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00000020:00000080:2.0:1787393076.662251:0:7527:0:(genops.c:906:class_export_put()) final put ffff9de83f7df000/aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00000020:00000080:2.0:1787393076.662286:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83f7df000/aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 for lustre-OST0001 00000020:00000080:2.0:1787393076.662335:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de83f7da000 for lustre-OST0001 00010000:00010000:2.0:1787393076.712152:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393077.097207:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338442752:0@lo:400:kworker.0 00000100:00100000:1.0:1787393077.097208:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338442624:0@lo:400:kworker.0 00000100:00100000:0.0:1787393077.097317:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338442496:0@lo:400:kworker.0 00000100:00100000:1.0:1787393077.101791:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393077.101973:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338443136:0@lo:400:kworker.0 00000100:00100000:1.0:1787393077.102041:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393077.102108:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338443136 00000100:00100000:1.0:1787393077.102119:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338443136 00000100:00100000:1.0:1787393077.102186:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787393077.102197:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338443136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393077.102417:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393077.102465:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338443008:0@lo:400:kworker.0 00000100:00100000:0.0:1787393077.102500:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393077.102541:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338442624 00000100:00100000:0.0:1787393077.102545:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338442624 00000100:00100000:0.0:1787393077.102585:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338443008 00000100:00100000:0.0:1787393077.102588:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338443008 00000100:00100000:0.0:1787393077.102607:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787393077.102614:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338442624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393077.102661:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338442624:12345-0@lo:400:kworker.0 Request processed in 46us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393077.102669:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787393077.102688:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787393077.102694:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338443008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393077.102741:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338443008:12345-0@lo:400:kworker.0 Request processed in 47us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393077.102748:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787393077.102771:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338442496 00000100:00100000:0.0:1787393077.102774:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338442496 00000100:00100000:0.0:1787393077.102805:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787393077.102813:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338442496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393077.102859:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338442496:12345-0@lo:400:kworker.0 Request processed in 47us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393077.102866:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787393077.102931:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338442624:0@lo:400:kworker.0 00000100:00100000:1.0:1787393077.102939:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338443136:12345-0@lo:400:kworker.0 Request processed in 742us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393077.102949:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787393077.102954:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de810334380 x1874217338443136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787393077.102977:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393077.102983:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338443136:0@lo:400:kworker.0 00000100:00080000:1.0:1787393077.102984:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787393077.103034:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338442496:0@lo:400:kworker.0 00000100:00100000:0.0:1787393077.103045:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338443008:0@lo:400:kworker.0 00000100:00100000:2.0:1787393077.103239:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393077.103274:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338442752 00000100:00100000:2.0:1787393077.103278:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338442752 00000100:00100000:2.0:1787393077.103327:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787393077.103336:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338442752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393077.103379:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338442752:12345-0@lo:400:kworker.0 Request processed in 44us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393077.103386:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787393077.103412:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338442880:0@lo:400:kworker.0 00000100:00100000:2.0:1787393077.103446:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393077.103490:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338442880 00000100:00100000:2.0:1787393077.103495:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338442880 00000100:00100000:2.0:1787393077.103522:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787393077.103535:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338442880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393077.103568:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338442880:12345-0@lo:400:kworker.0 Request processed in 33us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393077.103575:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787393077.103609:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de810335f80 x1874217338442880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393077.103620:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338442880:0@lo:400:kworker.0 00000100:00080000:2.0:1787393077.103635:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787393077.103657:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338442752:0@lo:400:kworker.0 00000100:00100000:2.0:1787393077.611210:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338443264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787393077.611312:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393077.611758:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338443264 00000100:00100000:1.0:1787393077.611772:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338443264 00000100:00100000:1.0:1787393077.611870:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787393077.611881:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338443264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787393077.611931:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393077.612017:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338443264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393077.612025:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787393077.612083:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83f75ce00 x1874217338443264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393077.612106:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338443264:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787393077.738781:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393078.617767:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393078.617813:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393078.623535:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319538816 00000100:00100000:0.0:1787393078.623552:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319538816 00000100:00100000:0.0:1787393078.623639:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:0.0:1787393078.623651:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2353:x1874217319538816:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393078.623743:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2353:x1874217319538816:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 95us (5928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393078.623751:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:2.0:1787393078.624271:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319538688 00000100:00100000:2.0:1787393078.624278:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319538688 00000100:00100000:2.0:1787393078.624328:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 196 00000100:00100000:2.0:1787393078.624335:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+10:2353:x1874217319538688:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393078.624368:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+10:2353:x1874217319538688:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 34us (6610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393078.624375:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 196 00000100:00080000:2.0:1787393078.624402:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787393078.641511:0:9222:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.109 00010000:00010000:1.0:1787393078.764114:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393079.785403:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393080.811571:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787393081.146811:0:9320:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.109 00000100:00100000:3.0:1787393081.705114:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338443392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787393081.705185:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393081.705261:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338443392 00000100:00100000:3.0:1787393081.705269:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338443392 00000100:00100000:3.0:1787393081.705321:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787393081.705331:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338443392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787393081.705362:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787393081.705365:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787393081.705406:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338443392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393081.705426:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787393081.705431:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de810335f80 x1874217338443392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393081.705452:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338443392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787393081.832184:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393082.216178:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338443776:0@lo:400:kworker.0 00000100:00100000:3.0:1787393082.216252:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393082.216380:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338443520:0@lo:400:kworker.0 00000100:00100000:0.0:1787393082.216422:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393082.216437:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338443648:0@lo:400:kworker.0 00000100:00100000:3.0:1787393082.219445:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787393082.219466:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338443904:0@lo:400:kworker.0 00000100:00100000:2.0:1787393082.223599:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393082.223701:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338443776 00000100:00100000:2.0:1787393082.223710:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338443776 00000100:00100000:2.0:1787393082.223761:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338443648 00000100:00100000:2.0:1787393082.223776:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338443648 00000100:00100000:2.0:1787393082.225264:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787393082.225284:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338443776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393082.225485:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338443776:12345-0@lo:400:kworker.0 Request processed in 210us (9233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393082.225493:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787393082.225515:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787393082.225521:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338443648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393082.225568:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338443648:12345-0@lo:400:kworker.0 Request processed in 25us (1952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393082.225574:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1787393082.225596:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393082.225632:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338443520 00000100:00100000:1.0:1787393082.225638:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338443520 00000100:00100000:2.0:1787393082.225691:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338444160:0@lo:400:kworker.0 00000100:00100000:2.0:1787393082.225726:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393082.227075:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338444032:0@lo:400:kworker.0 00000100:00100000:0.0:1787393082.227128:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393082.227169:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338444032 00000100:00100000:3.0:1787393082.227176:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338444032 00000100:00080000:0.0:1787393082.227594:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393082.228825:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787393082.228924:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338443520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393082.229007:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338443520:12345-0@lo:400:kworker.0 Request processed in 93us (12584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393082.229014:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787393082.230061:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338443520:0@lo:400:kworker.0 00000100:00100000:2.0:1787393082.232283:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338444160 00000100:00100000:2.0:1787393082.232295:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338444160 00000100:00100000:2.0:1787393082.232370:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787393082.232379:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338444160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393082.232447:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338444160:12345-0@lo:400:kworker.0 Request processed in 69us (6720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393082.232454:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787393082.232479:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787393082.232487:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338444032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393082.232519:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338444032:12345-0@lo:400:kworker.0 Request processed in 33us (5392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393082.232524:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787393082.232584:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83f5a9880 x1874217338444160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393082.232600:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338444160:0@lo:400:kworker.0 00000100:00100000:2.0:1787393082.232615:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338443648:0@lo:400:kworker.0 00000100:00100000:1.0:1787393082.232818:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393082.232908:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338443776:0@lo:400:kworker.0 00000100:00080000:0.0:1787393082.233065:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787393082.233102:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338444032:0@lo:400:kworker.0 00000100:00100000:2.0:1787393082.233491:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338443904 00000100:00100000:2.0:1787393082.233499:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338443904 00000100:00100000:2.0:1787393082.233575:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787393082.233584:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338443904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393082.233643:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338443904:12345-0@lo:400:kworker.0 Request processed in 60us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393082.233649:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787393082.233717:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83f5aaa00 x1874217338443904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393082.233728:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338443904:0@lo:400:kworker.0 00000100:00100000:2.0:1787393082.728815:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338444288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787393082.728908:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393082.728983:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338444288 00000100:00100000:1.0:1787393082.729005:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338444288 00000100:00100000:1.0:1787393082.729322:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787393082.729332:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338444288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787393082.729365:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393082.729410:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338444288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393082.729417:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787393082.734228:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83f75ca80 x1874217338444288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393082.734255:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338444288:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787393082.864372:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787393083.333612:0:9368:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 06:04:41 EDT 2026 00000100:00100000:0.0:1787393083.735647:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393083.735891:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319538944 00000100:00100000:2.0:1787393083.735906:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319538944 00000100:00100000:2.0:1787393083.735979:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 198 00000100:00100000:0.0:1787393083.735989:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393083.736019:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+10:2353:x1874217319538944:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393083.736129:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+10:2353:x1874217319538944:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 124us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393083.736138:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 198 00000100:00100000:3.0:1787393083.736410:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319539072 00000100:00100000:3.0:1787393083.736416:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319539072 00000100:00100000:3.0:1787393083.736478:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00100000:3.0:1787393083.736486:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2353:x1874217319539072:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393083.736536:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2353:x1874217319539072:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 39us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393083.736544:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00080000:2.0:1787393083.737485:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787393083.888149:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393084.904026:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393085.930476:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393086.825092:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787393086.825123:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338444416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787393086.825192:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393086.825419:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338444416 00000100:00100000:2.0:1787393086.825427:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338444416 00000100:00100000:2.0:1787393086.825518:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787393086.825529:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338444416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787393086.825559:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393086.825611:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338444416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393086.825618:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787393086.825752:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de82c8d1180 x1874217338444416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393102 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393086.825772:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338444416:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787393086.825835:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787393086.952122:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393087.336503:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338444928:0@lo:400:kworker.0 00000100:00100000:3.0:1787393087.336676:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393087.336774:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787393087.336796:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338444800:0@lo:400:kworker.0 00000100:00100000:3.0:1787393087.336883:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393087.336922:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338444800 00000100:00100000:3.0:1787393087.336929:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338444800 00000100:00100000:3.0:1787393087.337031:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787393087.337063:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338444800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393087.337140:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338444800:12345-0@lo:400:kworker.0 Request processed in 79us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393087.337161:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787393087.337258:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338444800:0@lo:400:kworker.0 00000100:00100000:2.0:1787393087.337717:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338444672:0@lo:400:kworker.0 00000100:00100000:2.0:1787393087.337806:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393087.337905:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338445184:0@lo:400:kworker.0 00000100:00100000:2.0:1787393087.337947:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393087.338092:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787393087.338100:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338444544:0@lo:400:kworker.0 00000100:00100000:2.0:1787393087.338184:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393087.338240:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338445056:0@lo:400:kworker.0 00000100:00100000:2.0:1787393087.338290:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393087.338347:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338444928 00000100:00100000:2.0:1787393087.338364:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338444928 00000100:00100000:2.0:1787393087.338714:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338445184 00000100:00100000:2.0:1787393087.338718:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338445184 00000100:00100000:2.0:1787393087.338754:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787393087.339765:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338444672 00000100:00100000:3.0:1787393087.339782:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338444672 00000100:00100000:3.0:1787393087.339833:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338445056 00000100:00100000:3.0:1787393087.339881:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338445056 00000100:00100000:3.0:1787393087.339915:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787393087.339925:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338444672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393087.340039:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338444672:12345-0@lo:400:kworker.0 Request processed in 115us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393087.340058:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787393087.340085:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787393087.340093:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338445056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393087.340132:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338445056:12345-0@lo:400:kworker.0 Request processed in 41us (1855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393087.340166:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787393087.340244:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338445056:0@lo:400:kworker.0 00000100:00100000:3.0:1787393087.340258:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338444672:0@lo:400:kworker.0 00000100:00100000:3.0:1787393087.340338:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787393087.340347:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338445184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393087.341042:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338444928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393087.342043:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338444544 00000100:00100000:1.0:1787393087.342053:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338444544 00000100:00100000:1.0:1787393087.342098:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787393087.342119:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338444544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393087.342242:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338444544:12345-0@lo:400:kworker.0 Request processed in 123us (4043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393087.342250:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787393087.342491:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338444544:0@lo:400:kworker.0 00000100:00100000:2.0:1787393087.343553:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338444928:12345-0@lo:400:kworker.0 Request processed in 2379us (4464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393087.343590:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1787393087.343913:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83f75df80 x1874217338444928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393087.343937:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338444928:0@lo:400:kworker.0 00000100:00100000:3.0:1787393087.344099:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338445184:12345-0@lo:400:kworker.0 Request processed in 3752us (6149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393087.344128:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787393087.344510:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787393087.344529:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787393087.345099:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83f75ce00 x1874217338445184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393087.345127:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338445184:0@lo:400:kworker.0 00000100:00100000:1.0:1787393087.852815:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338445312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787393087.852948:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393087.853042:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338445312 00000100:00100000:1.0:1787393087.853050:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338445312 00000100:00100000:1.0:1787393087.853103:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787393087.853114:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338445312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787393087.853156:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393087.853208:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338445312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393087.853216:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787393087.853482:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de82c8d1500 x1874217338445312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393087.853505:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338445312:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787393087.976977:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393088.859161:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393088.859209:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393088.859238:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319539328 00000100:00100000:2.0:1787393088.859247:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319539328 00000100:00100000:2.0:1787393088.859305:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:2.0:1787393088.859316:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2353:x1874217319539328:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393088.860183:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319539200 00000100:00100000:3.0:1787393088.860191:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319539200 00000100:00100000:3.0:1787393088.860234:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 200 00000100:00100000:3.0:1787393088.860242:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+10:2353:x1874217319539200:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393088.860316:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+10:2353:x1874217319539200:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 73us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393088.860333:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 200 00000100:00100000:2.0:1787393088.860966:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2353:x1874217319539328:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 1651us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393088.860974:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00080000:2.0:1787393088.860996:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787393089.000061:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393090.024163:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393091.053209:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393091.956969:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338445440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787393091.957059:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393091.957148:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338445440 00000100:00100000:2.0:1787393091.957157:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338445440 00000100:00100000:2.0:1787393091.957222:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787393091.957245:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338445440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787393091.957291:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393091.957340:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338445440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393091.957348:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787393091.957385:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787393091.957424:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de82c8d0380 x1874217338445440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393091.957460:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338445440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787393092.072083:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393092.459069:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338445824:0@lo:400:kworker.0 00000100:00100000:3.0:1787393092.459158:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393092.459236:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787393092.459242:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3326:1874217338445952:0@lo:400:kworker.0 00000100:00100000:3.0:1787393092.459263:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393092.459300:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338445824 00000100:00100000:3.0:1787393092.459308:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338445824 00000100:00100000:3.0:1787393092.459359:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338445952 00000100:00100000:3.0:1787393092.459361:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338445952 00000100:00100000:3.0:1787393092.459378:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787393092.459387:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338445824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393092.459441:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338445824:12345-0@lo:400:kworker.0 Request processed in 54us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393092.459448:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787393092.459468:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787393092.459474:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1874217338445952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393092.459498:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1874217338445952:12345-0@lo:400:kworker.0 Request processed in 25us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393092.459519:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787393092.459537:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393092.459571:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3326:1874217338445952:0@lo:400:kworker.0 00000100:00100000:3.0:1787393092.459612:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338445824:0@lo:400:kworker.0 00000100:00100000:1.0:1787393092.459661:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338445696:0@lo:400:kworker.0 00000100:00100000:1.0:1787393092.459695:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393092.459726:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787393092.459732:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338445568:0@lo:400:kworker.0 00000100:00100000:1.0:1787393092.459765:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393092.459789:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338445696 00000100:00100000:1.0:1787393092.459790:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338446080:0@lo:400:kworker.0 00000100:00100000:3.0:1787393092.459793:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338445696 00000100:00100000:1.0:1787393092.459816:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393092.459824:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787393092.459831:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338445696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393092.459870:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338445568 00000100:00100000:1.0:1787393092.459875:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338445568 00000100:00100000:3.0:1787393092.459881:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338445696:12345-0@lo:400:kworker.0 Request processed in 51us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393092.459886:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787393092.459904:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787393092.459911:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338445568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393092.459952:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338445568:12345-0@lo:400:kworker.0 Request processed in 41us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393092.459958:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787393092.459993:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338446080 00000100:00100000:1.0:1787393092.459997:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338446080 00000100:00080000:3.0:1787393092.460043:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787393092.460046:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787393092.460054:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338446080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393092.460085:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338446080:12345-0@lo:400:kworker.0 Request processed in 32us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393092.460091:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787393092.460138:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338445568:0@lo:400:kworker.0 00010000:00080000:1.0:1787393092.460150:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83f75ce00 x1874217338446080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393092.460161:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338446080:0@lo:400:kworker.0 00000100:00100000:1.0:1787393092.460170:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338445696:0@lo:400:kworker.0 00000100:00100000:0.0:1787393092.968551:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787393092.968596:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338446208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787393092.968706:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393092.969574:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338446208 00000100:00100000:0.0:1787393092.969596:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338446208 00000100:00100000:0.0:1787393092.969673:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787393092.969685:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338446208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787393092.969732:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393092.970220:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338446208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 536us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393092.970230:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787393092.971678:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8351b4e00 x1874217338446208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393092.971710:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338446208:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787393093.096480:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393093.981521:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393093.981577:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393093.982256:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319539584 00000100:00100000:1.0:1787393093.982271:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319539584 00000100:00100000:1.0:1787393093.982361:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 54 00000100:00100000:1.0:1787393093.982372:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2354:x1874217319539584:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393093.982475:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2354:x1874217319539584:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 104us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393093.982494:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 54 00000100:00080000:2.0:1787393093.982977:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393093.984014:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319539456 00000100:00100000:3.0:1787393093.984026:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319539456 00000100:00100000:3.0:1787393093.984096:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 202 00000100:00100000:3.0:1787393093.984106:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+10:2354:x1874217319539456:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393093.984181:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+10:2354:x1874217319539456:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 76us (2603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393093.984188:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 202 00010000:00010000:3.0:1787393094.120129:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393095.148804:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393096.170223:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393097.068420:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338446336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787393097.068719:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393097.068791:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338446336 00000100:00100000:0.0:1787393097.068798:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338446336 00000100:00100000:0.0:1787393097.068869:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787393097.068879:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338446336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787393097.068914:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393097.068958:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338446336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393097.068976:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787393097.070654:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787393097.072612:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8351b4000 x1874217338446336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393097.072637:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338446336:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787393097.197704:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393097.584921:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338446464:0@lo:400:kworker.0 00000100:00100000:0.0:1787393097.584988:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393097.585030:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8082e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338446976:0@lo:400:kworker.0 00000100:00100000:0.0:1787393097.585056:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393097.585654:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338446976 00000100:00100000:2.0:1787393097.585663:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338446976 00000100:00100000:0.0:1787393097.586413:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787393097.586424:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8082eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338446848:0@lo:400:kworker.0 00000100:00100000:0.0:1787393097.586792:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393097.586832:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8082e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3325:1874217338446720:0@lo:400:kworker.0 00000100:00100000:0.0:1787393097.586869:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393097.586887:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787393097.586892:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338446592:0@lo:400:kworker.0 00000100:00100000:0.0:1787393097.586909:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393097.586930:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338446848 00000100:00100000:0.0:1787393097.586935:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338446848 00000100:00100000:0.0:1787393097.586967:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338446720 00000100:00100000:0.0:1787393097.586970:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338446720 00000100:00100000:0.0:1787393097.586980:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338446592 00000100:00100000:0.0:1787393097.586982:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338446592 00000100:00100000:0.0:1787393097.586993:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787393097.587001:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874217338446848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393097.587059:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874217338446848:12345-0@lo:400:kworker.0 Request processed in 58us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393097.587066:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787393097.587189:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787393097.587197:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338446976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393097.590653:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338446976:12345-0@lo:400:kworker.0 Request processed in 3449us (5587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393097.590666:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787393097.590705:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787393097.590710:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787393097.591063:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787393097.591076:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1874217338446720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393097.591139:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1874217338446720:12345-0@lo:400:kworker.0 Request processed in 68us (4269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393097.591146:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787393097.591158:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787393097.591165:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338446592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393097.591193:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338446592:12345-0@lo:400:kworker.0 Request processed in 29us (4284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393097.591200:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787393097.591255:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8082eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338446848:0@lo:400:kworker.0 00010000:00080000:0.0:1787393097.591271:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8082e8e00 x1874217338446976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393097.591280:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8082e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338446976:0@lo:400:kworker.0 00000100:00100000:0.0:1787393097.591312:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338446592:0@lo:400:kworker.0 00000100:00100000:0.0:1787393097.591321:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8082e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3325:1874217338446720:0@lo:400:kworker.0 00000100:00100000:2.0:1787393097.595088:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338446464 00000100:00100000:2.0:1787393097.595102:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338446464 00000100:00100000:0.0:1787393097.595353:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787393097.595366:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3327:x1874217338446464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393097.595451:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3327:x1874217338446464:12345-0@lo:400:kworker.0 Request processed in 90us (10463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393097.595476:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787393097.595533:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338446464:0@lo:400:kworker.0 00000100:00100000:0.0:1787393098.089166:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787393098.089198:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8082e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338447104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787393098.089309:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393098.089590:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338447104 00000100:00100000:2.0:1787393098.089601:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338447104 00000100:00100000:2.0:1787393098.089671:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787393098.089682:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338447104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787393098.089731:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393098.089793:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338447104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393098.089801:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787393098.089880:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8082e9500 x1874217338447104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393098.089921:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8082e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338447104:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787393098.218444:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393099.096454:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393099.096508:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393099.096742:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319539712 00000100:00100000:2.0:1787393099.096752:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319539712 00000100:00100000:2.0:1787393099.096807:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 204 00000100:00100000:2.0:1787393099.096818:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+10:2355:x1874217319539712:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393099.097048:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+10:2355:x1874217319539712:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 231us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393099.097056:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 204 00000100:00100000:1.0:1787393099.097678:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319539840 00000100:00100000:1.0:1787393099.097694:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319539840 00000100:00100000:1.0:1787393099.097792:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00100000:1.0:1787393099.097804:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319539840:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393099.097941:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319539840:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 139us (1495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393099.097949:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00080000:2.0:1787393099.098065:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787393099.239996:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393100.266803:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787393100.894509:0:9998:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 06:04:58 (1787393098) === 00010000:00010000:0.0:1787393101.288603:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393101.482001:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393101.482540:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319539968 00000100:00100000:2.0:1787393101.482553:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319539968 00000100:00100000:2.0:1787393101.482636:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 205 00000100:00100000:2.0:1787393101.482649:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+10:8105:x1874217319539968:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787393101.482681:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393101.482708:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f1406 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d59a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393101.482746:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f1406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d59a expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393101.482760:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f1406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d59a expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393101.482773:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8029e2e00, rc 0) 00000100:00100000:2.0:1787393101.482894:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+11:8105:x1874217319539968:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 247us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393101.482926:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 205 00000100:00100000:3.0:1787393101.505986:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393101.506184:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319540096 00000100:00100000:0.0:1787393101.506198:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319540096 00000100:00100000:0.0:1787393101.506269:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 206 00000100:00100000:0.0:1787393101.506282:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+11:8105:x1874217319540096:12345-192.168.203.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787393101.506710:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+11:8105:x1874217319540096:12345-192.168.203.21@tcp:501:mount.lustre.0 Request processed in 428us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393101.506719:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 206 00000100:00100000:3.0:1787393101.515043:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393101.515183:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319540224 00000100:00100000:1.0:1787393101.515196:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319540224 00000100:00100000:1.0:1787393101.515267:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 207 00000100:00100000:1.0:1787393101.515278:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+11:8105:x1874217319540224:12345-192.168.203.21@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787393101.515609:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+11:8105:x1874217319540224:12345-192.168.203.21@tcp:503:mount.lustre.0 Request processed in 332us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393101.515618:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 207 00000100:00100000:1.0:1787393101.535786:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393101.536396:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319540352 00000100:00100000:2.0:1787393101.536421:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319540352 00000100:00100000:2.0:1787393101.536501:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 208 00000100:00100000:2.0:1787393101.536514:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+11:8109:x1874217319540352:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787393101.538511:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+11:8109:x1874217319540352:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 1982us (2724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393101.538536:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 208 00000100:00100000:3.0:1787393101.559412:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393101.569244:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319540480 00000100:00100000:0.0:1787393101.569269:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319540480 00000100:00100000:0.0:1787393101.569380:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 209 00000100:00100000:0.0:1787393101.569395:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+11:8109:x1874217319540480:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787393101.569835:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+11:8109:x1874217319540480:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 441us (10443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393101.569881:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 209 00000100:00100000:3.0:1787393101.578813:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393101.579309:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319540608 00000100:00100000:2.0:1787393101.579330:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319540608 00000100:00100000:2.0:1787393101.579408:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 210 00000100:00100000:2.0:1787393101.579420:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+11:8105:x1874217319540608:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787393101.579445:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393101.579471:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8029e3200/0x19a927d9c62f140d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d5c4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393101.579582:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8029e3200/0x19a927d9c62f140d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5c4 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393101.579596:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8029e3200/0x19a927d9c62f140d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5c4 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393101.579607:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8029e3200, rc 0) 00000100:00100000:2.0:1787393101.582733:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+12:8105:x1874217319540608:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 3294us (3917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393101.582750:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 210 00000100:00100000:2.0:1787393101.591761:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393101.592826:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319540736 00000100:00100000:1.0:1787393101.592864:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319540736 00000100:00100000:1.0:1787393101.592948:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 211 00000100:00100000:1.0:1787393101.592961:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+12:8105:x1874217319540736:12345-192.168.203.21@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787393101.593000:0:5813:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787393101.593035:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787393101.593040:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787393101.593044:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787393101.593047:0:5813:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787393101.604190:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+12:8105:x1874217319540736:12345-192.168.203.21@tcp:256:mount.lustre.0 Request processed in 11209us (12420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393101.604213:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 211 00000100:00100000:3.0:1787393101.609998:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393101.610188:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319540864 00000100:00100000:1.0:1787393101.610203:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319540864 00000100:00100000:1.0:1787393101.610278:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 212 00000100:00100000:1.0:1787393101.610290:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+12:8105:x1874217319540864:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787393101.610313:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393101.610336:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f1414 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d5cb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393101.610375:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f1414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5cb expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393101.610389:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f1414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5cb expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393101.610411:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d9800, rc 0) 00000100:00100000:1.0:1787393101.610495:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:8105:x1874217319540864:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 195us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393101.610504:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 212 00000100:00100000:0.0:1787393101.615428:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393101.615607:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319540992 00000100:00100000:1.0:1787393101.615622:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319540992 00000100:00100000:1.0:1787393101.615714:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 213 00000100:00100000:1.0:1787393101.615726:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:8105:x1874217319540992:12345-192.168.203.21@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787393101.617618:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:8105:x1874217319540992:12345-192.168.203.21@tcp:501:mount.lustre.0 Request processed in 1877us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393101.617654:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 213 00000100:00100000:2.0:1787393101.621102:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393101.621331:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319541120 00000100:00100000:3.0:1787393101.621345:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319541120 00000100:00100000:3.0:1787393101.621423:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 214 00000100:00100000:3.0:1787393101.621436:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:8105:x1874217319541120:12345-192.168.203.21@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787393101.621767:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:8105:x1874217319541120:12345-192.168.203.21@tcp:503:mount.lustre.0 Request processed in 332us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393101.621776:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 214 00000100:00100000:3.0:1787393101.625133:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393101.625256:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319541248 00000100:00100000:2.0:1787393101.625271:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319541248 00000100:00100000:2.0:1787393101.625338:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 215 00000100:00100000:2.0:1787393101.625350:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:8113:x1874217319541248:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787393101.625713:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:8113:x1874217319541248:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 363us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393101.625723:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 215 00000100:00100000:0.0:1787393101.631363:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393101.631596:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319541376 00000100:00100000:1.0:1787393101.631610:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319541376 00000100:00100000:1.0:1787393101.631691:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 216 00000100:00100000:1.0:1787393101.631704:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:8113:x1874217319541376:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787393101.632075:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:8113:x1874217319541376:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 373us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393101.632084:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 216 00000100:00100000:1.0:1787393101.636972:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393101.637012:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393101.637127:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319541504 00000100:00100000:0.0:1787393101.637142:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319541504 00000100:00100000:0.0:1787393101.637198:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319541888 00000100:00100000:0.0:1787393101.637201:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319541888 00000100:00100000:0.0:1787393101.637264:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 59 00000100:00100000:0.0:1787393101.637277:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2354:x1874217319541888:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393101.637391:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2354:x1874217319541888:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 115us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393101.637412:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 59 00000100:00100000:0.0:1787393101.637434:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:0.0:1787393101.637440:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1874217319541504:12345-192.168.203.21@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787393101.637469:0:5822:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 15e12ae6-dd1f-41b4-a172-edb7633b42fc@192.168.203.21@tcp t0 exp 0000000000000000 cur 250 last 0 00000100:00080000:3.0:1787393101.637633:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1787393101.637815:0:5822:0:(genops.c:1406:class_connect()) connect: client 15e12ae6-dd1f-41b4-a172-edb7633b42fc, cookie 0x19a927d9c62f141b 00000004:00100000:0.0:1787393101.637894:0:5822:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787393101.638233:0:5822:0:(import.c:65:import_set_state_nolock()) ffff9de83fd48800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787393101.638281:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:2352:x1874217319541504:12345-192.168.203.21@tcp:38:mount.lustre.0 Request processed in 838us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393101.638290:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:3.0:1787393101.652337:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393101.653629:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319541760 00000100:00100000:0.0:1787393101.653648:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319541760 00000100:00080000:3.0:1787393101.653982:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393101.654380:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:1.0:1787393101.654398:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:8105:x1874217319541760:12345-192.168.203.21@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787393101.654471:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787393101.654616:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:8105:x1874217319541760:12345-192.168.203.21@tcp:41:mount.lustre.0 Request processed in 224us (2293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393101.654626:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:0.0:1787393101.657418:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393101.660098:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393101.660280:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319541632 00000100:00100000:2.0:1787393101.660296:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319541632 00000100:00100000:2.0:1787393101.660382:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:2.0:1787393101.660394:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:0:x1874217319541632:12345-192.168.203.21@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787393101.660448:0:5821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787393101.660574:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:0:x1874217319541632:12345-192.168.203.21@tcp:41:mount.lustre.0 Request processed in 181us (3181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393101.660583:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:3.0:1787393101.663260:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319542016 00000100:00100000:3.0:1787393101.663283:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319542016 00000100:00100000:2.0:1787393101.663756:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:2.0:1787393101.663769:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:8105:x1874217319542016:12345-192.168.203.21@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787393101.663922:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:8105:x1874217319542016:12345-192.168.203.21@tcp:40:mount.lustre.0 Request processed in 155us (3838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393101.663932:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:2.0:1787393101.667620:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393101.667674:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393101.667702:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319542144 00000100:00100000:1.0:1787393101.667715:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319542144 00000100:00100000:2.0:1787393101.667722:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393101.667762:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319542272 00000100:00100000:1.0:1787393101.667765:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319542272 00000100:00100000:1.0:1787393101.667786:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:1.0:1787393101.667797:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1874217319542144:12345-192.168.203.21@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787393101.667860:0:6624:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 15e12ae6-dd1f-41b4-a172-edb7633b42fc@192.168.203.21@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:1.0:1787393101.667904:0:6624:0:(genops.c:1406:class_connect()) connect: client 15e12ae6-dd1f-41b4-a172-edb7633b42fc, cookie 0x19a927d9c62f1422 00000100:00100000:2.0:1787393101.667910:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:2.0:1787393101.667917:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874217319542272:12345-192.168.203.21@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787393101.667934:0:6622:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 15e12ae6-dd1f-41b4-a172-edb7633b42fc@192.168.203.21@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:2.0:1787393101.667955:0:6622:0:(genops.c:1406:class_connect()) connect: client 15e12ae6-dd1f-41b4-a172-edb7633b42fc, cookie 0x19a927d9c62f1429 00002000:00100000:2.0:1787393101.667970:0:6622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 15e12ae6-dd1f-41b4-a172-edb7633b42fc/ffff9de83f7dc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787393101.668002:0:6622:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:1.0:1787393101.668769:0:6624:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 15e12ae6-dd1f-41b4-a172-edb7633b42fc/ffff9de83f653800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787393101.668792:0:6624:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787393101.669792:0:6624:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787393101.669888:0:6624:0:(import.c:65:import_set_state_nolock()) ffff9de83f655000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787393101.670049:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:2352:x1874217319542144:12345-192.168.203.21@tcp:8:mount.lustre.0 Request processed in 2196us (2388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393101.670063:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:0.0:1787393101.670126:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319542400 00000100:00100000:0.0:1787393101.670135:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319542400 00000100:00100000:0.0:1787393101.670232:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:0.0:1787393101.670245:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:8105:x1874217319542400:12345-192.168.203.21@tcp:33:mount.lustre.0 00002000:00080000:2.0:1787393101.670483:0:6622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787393101.670525:0:6622:0:(import.c:65:import_set_state_nolock()) ffff9de83f7df000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787393101.670604:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:2352:x1874217319542272:12345-192.168.203.21@tcp:8:mount.lustre.0 Request processed in 2684us (2928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393101.670615:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 13 00000004:00200000:0.0:1787393101.671083:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787393101.671229:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:8105:x1874217319542400:12345-192.168.203.21@tcp:33:mount.lustre.0 Request processed in 986us (3504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393101.671238:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:1.0:1787393102.184192:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787393102.184223:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8082e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338447232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787393102.184358:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393102.184507:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338447232 00000100:00100000:0.0:1787393102.184517:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338447232 00000100:00100000:0.0:1787393102.184607:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787393102.184617:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338447232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787393102.184646:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393102.184710:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338447232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393102.184718:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787393102.186769:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787393102.186877:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8082e9f80 x1874217338447232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393102.186909:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8082e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338447232:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787393102.228015:0:7527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 15e12ae6-dd1f-41b4-a172-edb7633b42fc 00010000:00010000:3.0:1787393102.312239:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393102.702973:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338447360:0@lo:400:kworker.0 00000100:00100000:3.0:1787393102.703044:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393102.703093:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8186b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338447872:0@lo:400:kworker.0 00000100:00100000:3.0:1787393102.703121:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393102.703151:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787393102.703158:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874217338447488:0@lo:400:kworker.0 00000100:00100000:3.0:1787393102.703182:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393102.703210:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338447616:0@lo:400:kworker.0 00000100:00100000:3.0:1787393102.703231:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393102.703247:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787393102.703269:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338447744:0@lo:400:kworker.0 00000100:00100000:3.0:1787393102.703293:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393102.703322:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338447360 00000100:00100000:3.0:1787393102.703329:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338447360 00000100:00100000:3.0:1787393102.703386:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787393102.703396:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3326:x1874217338447360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393102.703442:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3326:x1874217338447360:12345-0@lo:400:kworker.0 Request processed in 48us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393102.703451:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787393102.703497:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338447872 00000100:00100000:3.0:1787393102.703501:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338447872 00000100:00100000:3.0:1787393102.703553:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787393102.703560:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338447872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393102.703590:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338447872:12345-0@lo:400:kworker.0 Request processed in 31us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393102.703597:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787393102.703614:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338447488 00000100:00100000:3.0:1787393102.703617:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338447488 00000100:00100000:3.0:1787393102.703632:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338447616 00000100:00100000:3.0:1787393102.703635:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338447616 00000100:00100000:3.0:1787393102.703648:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338447744 00000100:00100000:3.0:1787393102.703651:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338447744 00000100:00100000:3.0:1787393102.703665:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787393102.703670:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1874217338447488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393102.703699:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1874217338447488:12345-0@lo:400:kworker.0 Request processed in 29us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393102.703705:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787393102.703716:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787393102.703728:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338447616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393102.703760:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338447616:12345-0@lo:400:kworker.0 Request processed in 33us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393102.703766:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787393102.703778:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787393102.703784:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338447744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393102.703808:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338447744:12345-0@lo:400:kworker.0 Request processed in 24us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393102.703813:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1787393102.703887:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393102.703893:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338447744:0@lo:400:kworker.0 00000100:00080000:1.0:1787393102.703899:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787393102.703912:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338447616:0@lo:400:kworker.0 00000100:00100000:3.0:1787393102.703947:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874217338447488:0@lo:400:kworker.0 00000100:00100000:3.0:1787393102.703955:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338447360:0@lo:400:kworker.0 00010000:00080000:3.0:1787393102.703966:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8186b2300 x1874217338447872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393102.703977:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8186b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338447872:0@lo:400:kworker.0 00000100:00100000:3.0:1787393103.210790:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338448000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787393103.211266:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393103.214972:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338448000 00000100:00100000:2.0:1787393103.214985:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338448000 00000100:00100000:2.0:1787393103.215044:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787393103.215055:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338448000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787393103.215087:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393103.215171:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338448000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (3906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393103.215178:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787393103.215323:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de82c8d2d80 x1874217338448000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393103.215345:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338448000:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787393103.244581:0:8343:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 15e12ae6-dd1f-41b4-a172-edb7633b42fc 00010000:00010000:2.0:1787393103.336135:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393104.366938:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393105.384464:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787393105.830076:0:6648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 15e12ae6-dd1f-41b4-a172-edb7633b42fc 00010000:00010000:3.0:1787393106.408928:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393106.779528:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393106.779557:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393106.779616:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393106.779639:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393106.779676:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393106.779717:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319542656 00000100:00100000:3.0:1787393106.779725:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319542656 00000100:00100000:3.0:1787393106.779778:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319542784 00000100:00100000:3.0:1787393106.779780:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319542784 00000100:00100000:3.0:1787393106.779791:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:3.0:1787393106.779797:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319542656:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393106.779880:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319542656:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 83us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393106.779885:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:3.0:1787393106.779896:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:3.0:1787393106.779900:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319542784:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393106.779914:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319542784:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 14us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393106.779917:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:0.0:1787393106.779994:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319542528 00000100:00100000:0.0:1787393106.779997:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319542528 00000100:00100000:0.0:1787393106.780022:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 218 00000100:00100000:0.0:1787393106.780026:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319542528:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393106.780044:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319542528:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 19us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393106.780048:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 218 00000100:00080000:0.0:1787393106.780080:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787393106.780329:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319542912 00000100:00100000:2.0:1787393106.780334:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319542912 00000100:00100000:2.0:1787393106.780379:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319543040 00000100:00100000:2.0:1787393106.780388:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319543040 00000100:00080000:0.0:1787393106.780388:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787393106.780413:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787393106.780419:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:2.0:1787393106.780426:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319542912:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393106.780692:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:1.0:1787393106.780701:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319543040:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393106.782320:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319542912:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 1888us (2754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393106.782330:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:1.0:1787393106.782338:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319543040:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 1615us (2637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393106.782349:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 30 00000001:02000400:2.0:1787393107.149737:0:10197:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1787393107.304439:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8082eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338448128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787393107.304516:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393107.305009:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338448128 00000100:00100000:0.0:1787393107.305017:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338448128 00000100:00100000:0.0:1787393107.305457:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787393107.305467:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338448128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787393107.305521:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393107.305578:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338448128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393107.305586:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787393107.307230:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787393107.307627:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8082eb100 x1874217338448128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393107.307651:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8082eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338448128:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787393107.435311:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393107.817362:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338448512:0@lo:400:kworker.0 00000100:00100000:1.0:1787393107.817440:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393107.817525:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787393107.817531:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338448384:0@lo:400:kworker.0 00000100:00100000:1.0:1787393107.817554:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393107.817578:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338448640:0@lo:400:kworker.0 00000100:00100000:1.0:1787393107.817598:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393107.817612:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787393107.817617:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338448256:0@lo:400:kworker.0 00000100:00100000:1.0:1787393107.817640:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393107.817658:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338448768:0@lo:400:kworker.0 00000100:00100000:1.0:1787393107.817679:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393107.818095:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338448512 00000100:00100000:2.0:1787393107.818102:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338448512 00000100:00100000:2.0:1787393107.818146:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338448384 00000100:00100000:2.0:1787393107.818149:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338448384 00000100:00100000:2.0:1787393107.818161:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338448640 00000100:00100000:2.0:1787393107.818163:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338448640 00000100:00100000:2.0:1787393107.818178:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787393107.818186:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338448512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393107.818239:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338448512:12345-0@lo:400:kworker.0 Request processed in 53us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393107.818246:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787393107.818275:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787393107.818282:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338448384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393107.818307:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338448384:12345-0@lo:400:kworker.0 Request processed in 26us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393107.818324:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787393107.818334:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787393107.818340:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338448640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393107.818365:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338448640:12345-0@lo:400:kworker.0 Request processed in 26us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393107.818370:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787393107.818411:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338448384:0@lo:400:kworker.0 00000100:00100000:2.0:1787393107.818423:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338448512:0@lo:400:kworker.0 00000100:00080000:2.0:1787393107.818474:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393107.818684:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338448640:0@lo:400:kworker.0 00000100:00100000:3.0:1787393107.818920:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338448256 00000100:00100000:3.0:1787393107.818925:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338448256 00000100:00100000:3.0:1787393107.818972:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787393107.818979:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338448256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393107.819023:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338448256:12345-0@lo:400:kworker.0 Request processed in 45us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393107.819030:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787393107.819063:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338448768 00000100:00100000:3.0:1787393107.819066:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338448768 00000100:00100000:3.0:1787393107.819101:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787393107.819107:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338448768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393107.819134:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338448768:12345-0@lo:400:kworker.0 Request processed in 27us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393107.819140:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787393107.819370:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787393107.819874:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338448256:0@lo:400:kworker.0 00010000:00080000:1.0:1787393107.819889:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83f5af800 x1874217338448768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393107.819900:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338448768:0@lo:400:kworker.0 00000100:00100000:1.0:1787393108.329637:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8186b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338448896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787393108.329714:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393108.331530:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338448896 00000100:00100000:0.0:1787393108.331540:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338448896 00000100:00100000:0.0:1787393108.331661:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787393108.331671:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338448896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787393108.331711:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393108.331772:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338448896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (2057us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393108.331779:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787393108.331867:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8186b0700 x1874217338448896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393108.331885:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8186b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338448896:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787393108.456106:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393109.480113:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393110.504163:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393111.533288:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393111.893981:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393111.894027:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393111.894058:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393111.894087:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393111.894119:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393111.894138:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319543424 00000100:00100000:1.0:1787393111.894146:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319543680 00000100:00100000:1.0:1787393111.894156:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319543680 00000100:00100000:0.0:1787393111.894157:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319543424 00000100:00100000:0.0:1787393111.894218:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319543296 00000100:00100000:3.0:1787393111.894223:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319543168 00000100:00100000:0.0:1787393111.894223:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319543296 00000100:00100000:3.0:1787393111.894230:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319543168 00000100:00100000:2.0:1787393111.894255:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:2.0:1787393111.894271:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2353:x1874217319543424:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393111.894272:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 220 00000100:00100000:3.0:1787393111.894284:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:2353:x1874217319543168:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393111.894347:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2353:x1874217319543424:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 82us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393111.894354:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:2.0:1787393111.894376:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319543552 00000100:00100000:2.0:1787393111.894380:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319543552 00000100:00100000:1.0:1787393111.894558:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00100000:1.0:1787393111.894573:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2353:x1874217319543680:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393111.895107:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:2353:x1874217319543168:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 824us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393111.895116:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 220 00000100:00100000:1.0:1787393111.895236:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2353:x1874217319543680:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 669us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393111.895244:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00100000:2.0:1787393111.896002:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:2.0:1787393111.896023:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2354:x1874217319543552:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393111.896103:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2354:x1874217319543552:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 82us (1983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393111.896110:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00080000:2.0:1787393111.896131:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787393111.896824:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:0.0:1787393111.896833:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2354:x1874217319543296:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393111.896887:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2354:x1874217319543296:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 55us (2828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393111.896895:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00080000:2.0:1787393111.896964:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787393111.896969:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393112.426707:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787393112.426728:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8082e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338449024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787393112.426817:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393112.428290:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338449024 00000100:00100000:1.0:1787393112.428302:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338449024 00000100:00100000:1.0:1787393112.428378:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787393112.428389:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338449024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787393112.428426:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787393112.428548:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787393112.428990:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338449024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 602us (2174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393112.429000:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787393112.429129:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8082e9180 x1874217338449024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393112.429149:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8082e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338449024:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787393112.552304:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393112.936209:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338449280:0@lo:400:kworker.0 00000100:00100000:2.0:1787393112.936278:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393112.936337:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338449792:0@lo:400:kworker.0 00000100:00100000:2.0:1787393112.936363:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393112.936393:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787393112.936400:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338449152:0@lo:400:kworker.0 00000100:00100000:2.0:1787393112.936427:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393112.936459:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338449664:0@lo:400:kworker.0 00000100:00100000:2.0:1787393112.936479:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393112.936507:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338449408:0@lo:400:kworker.0 00000100:00100000:2.0:1787393112.936533:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393112.936563:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787393112.936569:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338449536:0@lo:400:kworker.0 00000100:00100000:2.0:1787393112.936592:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393112.936598:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338449280 00000100:00100000:3.0:1787393112.936608:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338449280 00000100:00100000:2.0:1787393112.936638:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338449664 00000100:00100000:2.0:1787393112.936644:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338449664 00000100:00100000:3.0:1787393112.936651:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338449408 00000100:00100000:3.0:1787393112.936655:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338449408 00000100:00100000:2.0:1787393112.936688:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787393112.936699:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338449280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393112.936715:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338449792 00000100:00100000:1.0:1787393112.936721:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338449792 00000100:00100000:2.0:1787393112.936758:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338449280:12345-0@lo:400:kworker.0 Request processed in 60us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393112.936759:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338449536 00000100:00100000:1.0:1787393112.936764:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338449536 00000100:00100000:1.0:1787393112.936794:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787393112.936810:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338449792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393112.936881:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338449792:12345-0@lo:400:kworker.0 Request processed in 73us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393112.936897:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787393112.936914:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787393112.936921:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338449536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393112.936955:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338449536:12345-0@lo:400:kworker.0 Request processed in 35us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393112.936962:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1787393112.938099:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787393112.938107:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393112.938130:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787393112.938142:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787393112.938165:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338449152 00000100:00100000:1.0:1787393112.938172:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338449152 00000100:00100000:1.0:1787393112.938214:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787393112.938224:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338449152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393112.938465:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338449152:12345-0@lo:400:kworker.0 Request processed in 243us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393112.938473:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787393112.938952:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338449152:0@lo:400:kworker.0 00000100:00100000:3.0:1787393112.939055:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787393112.939067:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338449664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393112.939116:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338449280:0@lo:400:kworker.0 00000100:00100000:2.0:1787393112.939144:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787393112.939164:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787393112.939172:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787393112.939180:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338449408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393112.940856:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338449664:12345-0@lo:400:kworker.0 Request processed in 1772us (4354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393112.940869:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1787393112.941499:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83f5aed80 x1874217338449792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393112.941515:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338449792:0@lo:400:kworker.0 00000100:00100000:2.0:1787393112.941562:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338449408:12345-0@lo:400:kworker.0 Request processed in 2379us (5024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393112.941574:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787393112.941578:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338449664:0@lo:400:kworker.0 00010000:00080000:2.0:1787393112.941637:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83f5aca80 x1874217338449536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393112.941649:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338449536:0@lo:400:kworker.0 00000100:00100000:2.0:1787393112.941680:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338449408:0@lo:400:kworker.0 00000100:00100000:0.0:1787393113.448076:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787393113.448099:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8186b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338449920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787393113.448176:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393113.448972:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338449920 00000100:00100000:2.0:1787393113.448981:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338449920 00000100:00100000:2.0:1787393113.449030:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787393113.449039:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338449920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787393113.449069:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393113.449125:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338449920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393113.449132:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787393113.449166:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8186b1500 x1874217338449920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393113.449182:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8186b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338449920:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787393113.576108:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393114.600205:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393115.626404:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393116.649532:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393117.024282:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393117.024324:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393117.024364:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393117.024394:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319544192 00000100:00100000:2.0:1787393117.024403:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319544192 00000100:00100000:2.0:1787393117.024475:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:2.0:1787393117.024486:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2356:x1874217319544192:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393117.024549:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2356:x1874217319544192:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 66us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393117.024563:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00080000:2.0:1787393117.024582:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787393117.024755:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319543936 00000100:00100000:1.0:1787393117.024760:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319543936 00000100:00100000:1.0:1787393117.024799:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:1.0:1787393117.024806:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2356:x1874217319543936:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393117.024869:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2356:x1874217319543936:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 63us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393117.024876:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:3.0:1787393117.024964:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319543808 00000100:00100000:3.0:1787393117.024968:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319543808 00000100:00100000:3.0:1787393117.025007:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 222 00000100:00100000:3.0:1787393117.025014:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319543808:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393117.025045:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319543808:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 32us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393117.025052:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 222 00000100:00080000:2.0:1787393117.025372:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787393117.028325:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393117.028408:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319544064 00000100:00100000:3.0:1787393117.028418:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319544064 00000100:00100000:3.0:1787393117.028651:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 74 00000100:00100000:3.0:1787393117.028662:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319544064:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393117.028731:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319544064:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 71us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393117.028738:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 74 00000100:00100000:0.0:1787393117.029020:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00080000:2.0:1787393117.029123:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393117.029253:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319544320 00000100:00100000:3.0:1787393117.029258:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319544320 00000100:00100000:3.0:1787393117.030311:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:3.0:1787393117.030321:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319544320:12345-192.168.203.21@tcp:400:kworker.0 00000100:00080000:2.0:1787393117.030366:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787393117.030390:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319544320:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 69us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393117.030398:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:3.0:1787393117.547529:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787393117.547565:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8082e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338450048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787393117.547687:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393117.548434:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338450048 00000100:00100000:0.0:1787393117.548447:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338450048 00000100:00100000:0.0:1787393117.548551:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787393117.548563:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338450048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787393117.548620:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393117.548730:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338450048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393117.548739:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787393117.548943:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8082e9c00 x1874217338450048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393133 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393117.548967:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8082e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338450048:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787393117.549623:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787393117.674624:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393118.057178:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8082e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338450304:0@lo:400:kworker.0 00000100:00100000:0.0:1787393118.057246:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393118.057299:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8082e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338450816:0@lo:400:kworker.0 00000100:00100000:0.0:1787393118.057324:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393118.057355:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787393118.058621:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8082ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338450176:0@lo:400:kworker.0 00000100:00100000:0.0:1787393118.058677:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393118.058725:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8082eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338450688:0@lo:400:kworker.0 00000100:00100000:0.0:1787393118.058750:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393118.058795:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8082e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338450432:0@lo:400:kworker.0 00000100:00100000:0.0:1787393118.058834:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393118.058880:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787393118.058887:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8082e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338450560:0@lo:400:kworker.0 00000100:00100000:0.0:1787393118.058910:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393118.059467:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338450176 00000100:00100000:2.0:1787393118.059478:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338450176 00000100:00100000:2.0:1787393118.059528:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787393118.059538:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338450176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393118.063503:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338450176:12345-0@lo:400:kworker.0 Request processed in 3957us (4815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393118.063518:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787393118.067484:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338450304 00000100:00100000:0.0:1787393118.067499:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338450304 00000100:00100000:0.0:1787393118.067549:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338450688 00000100:00100000:0.0:1787393118.067552:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338450688 00000100:00100000:0.0:1787393118.067574:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338450432 00000100:00100000:0.0:1787393118.067577:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338450432 00000100:00100000:0.0:1787393118.067595:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787393118.067604:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338450304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393118.067683:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338450304:12345-0@lo:400:kworker.0 Request processed in 80us (10437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393118.067691:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787393118.067707:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787393118.067713:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338450688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393118.067765:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338450688:12345-0@lo:400:kworker.0 Request processed in 52us (9013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393118.067771:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787393118.067781:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787393118.067787:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338450432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393118.067815:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338450432:12345-0@lo:400:kworker.0 Request processed in 29us (8981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393118.067822:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787393118.067855:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338450816 00000100:00100000:0.0:1787393118.067871:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338450816 00000100:00100000:0.0:1787393118.067903:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338450560 00000100:00100000:0.0:1787393118.067906:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338450560 00000100:00100000:0.0:1787393118.067924:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787393118.067931:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338450816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393118.067970:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338450816:12345-0@lo:400:kworker.0 Request processed in 40us (10646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393118.067977:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787393118.067987:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787393118.067993:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338450560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393118.068018:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338450560:12345-0@lo:400:kworker.0 Request processed in 25us (9107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393118.068024:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1787393118.068050:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787393118.068054:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787393118.068094:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8082e9180 x1874217338450560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393118.068109:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8082e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338450560:0@lo:400:kworker.0 00000100:00100000:0.0:1787393118.068121:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8082e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338450432:0@lo:400:kworker.0 00000100:00100000:0.0:1787393118.068155:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8082ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338450176:0@lo:400:kworker.0 00000100:00100000:0.0:1787393118.068166:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8082eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338450688:0@lo:400:kworker.0 00000100:00100000:0.0:1787393118.068176:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8082e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338450304:0@lo:400:kworker.0 00010000:00080000:0.0:1787393118.068187:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8082e9f80 x1874217338450816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393118.068208:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8082e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338450816:0@lo:400:kworker.0 00000100:00100000:0.0:1787393118.569028:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338450944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787393118.569092:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393118.569153:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338450944 00000100:00100000:0.0:1787393118.569160:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338450944 00000100:00100000:0.0:1787393118.569210:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787393118.569219:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338450944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787393118.569486:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393118.569540:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338450944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 321us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393118.569547:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787393118.569676:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de834ecf480 x1874217338450944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393118.569694:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338450944:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787393118.696447:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393119.720026:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393120.744915:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393121.769448:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393122.149549:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393122.149596:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393122.149624:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393122.149912:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393122.149990:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393122.150022:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319544576 00000100:00100000:0.0:1787393122.150033:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319544576 00000100:00100000:0.0:1787393122.150088:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319544704 00000100:00100000:0.0:1787393122.150091:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319544704 00000100:00100000:0.0:1787393122.150113:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 78 00000100:00100000:0.0:1787393122.150122:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2353:x1874217319544576:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393122.150190:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2353:x1874217319544576:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 69us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393122.150198:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 78 00000100:00100000:0.0:1787393122.150224:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 79 00000100:00100000:0.0:1787393122.150230:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2353:x1874217319544704:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393122.150256:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2353:x1874217319544704:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 26us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393122.150262:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 79 00000100:00100000:0.0:1787393122.150280:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319544832 00000100:00100000:0.0:1787393122.150283:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319544832 00000100:00100000:0.0:1787393122.150306:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319544960 00000100:00100000:0.0:1787393122.150309:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319544960 00000100:00100000:0.0:1787393122.150331:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:0.0:1787393122.150337:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2352:x1874217319544832:12345-192.168.203.21@tcp:9:kworker.0 00000020:00000080:0.0:1787393122.150355:0:7525:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1422 00000100:00080000:0.0:1787393122.150364:0:7525:0:(import.c:65:import_set_state_nolock()) ffff9de83f655000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787393122.150411:0:7525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787393122.150417:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319544448 00000100:00100000:3.0:1787393122.150421:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319544448 00000100:00100000:3.0:1787393122.150446:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 224 00000100:00100000:3.0:1787393122.150451:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:2353:x1874217319544448:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393122.150489:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:2353:x1874217319544448:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 37us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393122.150496:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 224 00000100:00100000:0.0:1787393122.150794:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15e12ae6-dd1f-41b4-a172-edb7633b42fc+2:2352:x1874217319544832:12345-192.168.203.21@tcp:9:kworker.0 Request processed in 455us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393122.150800:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:0.0:1787393122.150813:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:0.0:1787393122.150818:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2352:x1874217319544960:12345-192.168.203.21@tcp:9:kworker.0 00000020:00000080:0.0:1787393122.150830:0:7525:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1429 00000100:00080000:0.0:1787393122.150835:0:7525:0:(import.c:65:import_set_state_nolock()) ffff9de83f7df000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787393122.150876:0:7525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787393122.151042:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15e12ae6-dd1f-41b4-a172-edb7633b42fc+2:2352:x1874217319544960:12345-192.168.203.21@tcp:9:kworker.0 Request processed in 222us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393122.151050:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00080000:0.0:1787393122.151073:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787393122.151083:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787393122.151087:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787393122.151232:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393122.152883:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787393122.234788:0:10899:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1787393122.664149:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338451072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787393122.664227:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393122.664356:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338451072 00000100:00100000:0.0:1787393122.664365:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338451072 00000100:00100000:0.0:1787393122.664431:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787393122.664440:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338451072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787393122.664476:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393122.664522:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338451072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393122.664530:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787393122.664550:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787393122.664581:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de834ecfb80 x1874217338451072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393122.664598:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338451072:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787393122.705079:0:7527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 15e12ae6-dd1f-41b4-a172-edb7633b42fc 00000020:00000080:3.0:1787393122.705089:0:7527:0:(genops.c:906:class_export_put()) final put ffff9de83f7dc000/15e12ae6-dd1f-41b4-a172-edb7633b42fc 00000020:00000080:1.0:1787393122.705158:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83f7dc000/15e12ae6-dd1f-41b4-a172-edb7633b42fc for lustre-OST0001 00000020:00000080:1.0:1787393122.705206:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de83f7df000 for lustre-OST0001 00010000:00010000:0.0:1787393122.792044:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393123.177235:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338451328:0@lo:400:kworker.0 00000100:00100000:1.0:1787393123.177297:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393123.177345:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338451840:0@lo:400:kworker.0 00000100:00100000:1.0:1787393123.177375:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393123.177416:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787393123.177422:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338451200:0@lo:400:kworker.0 00000100:00100000:1.0:1787393123.177448:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393123.177466:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338451712:0@lo:400:kworker.0 00000100:00100000:1.0:1787393123.177486:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393123.177521:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338451456:0@lo:400:kworker.0 00000100:00100000:1.0:1787393123.177541:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393123.177558:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787393123.177564:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338451584:0@lo:400:kworker.0 00000100:00100000:1.0:1787393123.177583:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393123.177625:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338451328 00000100:00100000:1.0:1787393123.177632:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338451328 00000100:00100000:1.0:1787393123.177679:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338451712 00000100:00100000:1.0:1787393123.177682:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338451712 00000100:00100000:2.0:1787393123.177956:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338451200 00000100:00100000:2.0:1787393123.177961:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338451200 00000100:00100000:2.0:1787393123.177990:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787393123.177998:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338451200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393123.178051:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338451200:12345-0@lo:400:kworker.0 Request processed in 54us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393123.178058:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787393123.178122:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338451456 00000100:00100000:1.0:1787393123.178127:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338451456 00000100:00100000:1.0:1787393123.178147:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787393123.178152:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338451328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393123.178184:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338451328:12345-0@lo:400:kworker.0 Request processed in 31us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393123.178189:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787393123.178202:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787393123.178208:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338451712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393123.178231:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338451712:12345-0@lo:400:kworker.0 Request processed in 24us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393123.178237:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787393123.178249:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787393123.178255:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338451456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393123.178542:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338451456:12345-0@lo:400:kworker.0 Request processed in 286us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393123.178549:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787393123.178570:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338451840 00000100:00100000:1.0:1787393123.178581:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338451840 00000100:00100000:1.0:1787393123.178608:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338451584 00000100:00100000:1.0:1787393123.178785:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338451584 00000100:00100000:1.0:1787393123.178902:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787393123.178912:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338451840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393123.178948:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338451840:12345-0@lo:400:kworker.0 Request processed in 39us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393123.178954:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787393123.179095:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787393123.179101:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338451584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393123.179124:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338451584:12345-0@lo:400:kworker.0 Request processed in 24us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393123.179129:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1787393123.179157:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787393123.179161:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393123.179191:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338451200:0@lo:400:kworker.0 00000100:00100000:1.0:1787393123.179203:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338451712:0@lo:400:kworker.0 00000100:00100000:1.0:1787393123.179215:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338451328:0@lo:400:kworker.0 00010000:00080000:1.0:1787393123.179226:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83ca23480 x1874217338451840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393123.179235:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338451840:0@lo:400:kworker.0 00010000:00080000:2.0:1787393123.179329:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83ca20380 x1874217338451584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393123.179338:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338451584:0@lo:400:kworker.0 00000100:00100000:2.0:1787393123.179348:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338451456:0@lo:400:kworker.0 00000100:00100000:1.0:1787393123.689646:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338451968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787393123.689709:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393123.689776:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338451968 00000100:00100000:1.0:1787393123.689784:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338451968 00000100:00100000:1.0:1787393123.690362:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787393123.690373:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338451968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787393123.690415:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393123.690461:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338451968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393123.690469:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787393123.693073:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83ca23480 x1874217338451968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393123.693098:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338451968:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787393123.817119:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393124.840730:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787393125.562274:0:11046:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd949e2c50 00000020:00000080:2.0:1787393125.562291:0:11046:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787393125.562295:0:11046:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787393125.562303:0:11046:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd949e4ee0 20000000:00000080:2.0:1787393125.562310:0:11046:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9de82d21e000 uarg=0000000000000000 20000000:01000000:2.0:1787393125.562348:0:11046:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787393125.562353:0:11046:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787393125.562359:0:11046:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787393125.563241:0:11047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787393125.563412:0:11046:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787393125.591138:0:11046:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787393125.598137:0:11046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1430 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393125.598162:0:11046:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de8040d9c00/0x19a927d9c62f13d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d593 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393125.598171:0:11046:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de8029e3400/0x19a927d9c62f13e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f13dc expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393125.598178:0:11046:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de80761de00/0x19a927d9c62f13f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f13ea expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393125.598184:0:11046:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de801531e00/0x19a927d9c62f13ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f13f8 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393125.598191:0:11046:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f1414 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5cb expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393125.598210:0:11046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1430 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393125.598255:0:11046:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f1414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5cb expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393125.598498:0:11046:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f1414 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5cb expref: 12 pid: 5814 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393125.598516:0:11046:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8186b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11046:1874217338452096:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393125.598685:0:11046:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de801531e00/0x19a927d9c62f13ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f13f8 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393125.598694:0:11046:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de801531e00/0x19a927d9c62f13ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f13f8 expref: 18 pid: 5813 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393125.598704:0:11046:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8186b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11046:1874217338452224:0@lo:104: 00000100:00100000:3.0:1787393125.598739:0:11046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787393125.598804:0:11046:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de80761de00/0x19a927d9c62f13f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f13ea expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393125.598812:0:11046:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de80761de00/0x19a927d9c62f13f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f13ea expref: 18 pid: 5814 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393125.598820:0:11046:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8186b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11046:1874217338452352:0@lo:104: 00000100:00100000:3.0:1787393125.598963:0:11046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787393125.606459:0:11046:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de8029e3400/0x19a927d9c62f13e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f13dc expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393125.606498:0:11046:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de8029e3400/0x19a927d9c62f13e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f13dc expref: 18 pid: 5815 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393125.606514:0:11046:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8186b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11046:1874217338452480:0@lo:104: 00000100:00100000:3.0:1787393125.606567:0:11046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393125.607730:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338452224 00000100:00100000:0.0:1787393125.607741:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338452224 00000100:00100000:0.0:1787393125.607788:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338452352 00000100:00100000:0.0:1787393125.607791:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338452352 00000100:00100000:0.0:1787393125.607807:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787393125.607816:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+4:11046:x1874217338452224:12345-0@lo:104: 00010000:00010000:0.0:1787393125.607835:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f13f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f13ff expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.608061:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787393125.608068:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+4:11046:x1874217338452224:12345-0@lo:104: Request processed in 252us (9327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393125.608075:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787393125.608092:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787393125.608098:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:11046:x1874217338452352:12345-0@lo:104: 00010000:00010000:0.0:1787393125.608105:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de801530200/0x19a927d9c62f13ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f13f1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.608137:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787393125.608142:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:11046:x1874217338452352:12345-0@lo:104: Request processed in 45us (9305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393125.608147:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1787393125.608163:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787393125.608178:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f13f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f13ff expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.608186:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8029e3800 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1787393125.608191:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f13f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f13ff expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.608200:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f13f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f13ff expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787393125.608207:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f13f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f13ff expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393125.608212:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787393125.608253:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f13f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f13ff expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.608261:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787393125.608281:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f13f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f13ff expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.608288:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8029e3800/0x19a927d9c62f13f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f13ff expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.608299:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393125.608303:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de801530200/0x19a927d9c62f13ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f13f1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.608308:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530200 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1787393125.608311:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de801530200/0x19a927d9c62f13ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f13f1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.608318:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de801530200/0x19a927d9c62f13ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f13f1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787393125.608324:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de801530200/0x19a927d9c62f13ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f13f1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393125.608329:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787393125.608341:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de801530200/0x19a927d9c62f13ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f13f1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.608346:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787393125.608371:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de801530200/0x19a927d9c62f13ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f13f1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.608389:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de801530200/0x19a927d9c62f13ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f13f1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.608399:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393125.608401:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393125.608403:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393125.608409:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393125.608429:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338452736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787393125.608468:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393125.608511:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338452736 00000100:00100000:0.0:1787393125.608516:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338452736 00010000:00010000:0.0:1787393125.608535:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de80761de00/0x19a927d9c62f13f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f13ea expref: 19 pid: 5814 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393125.608556:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787393125.608562:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de826cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338452736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787393125.608572:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393125.608577:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de80761de00/0x19a927d9c62f13f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f13ea expref: 19 pid: 5814 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.609025:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de80761de00/0x19a927d9c62f13f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f13ea expref: 19 pid: 5814 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.609046:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393125.609086:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de826cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338452736:12345-0@lo:103:ldlm_bl.0 Request processed in 524us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393125.609093:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787393125.609151:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787393125.609169:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338452608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787393125.609196:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393125.609231:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338452608 00000100:00100000:0.0:1787393125.609234:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338452608 00010000:00010000:0.0:1787393125.609250:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de801531e00/0x19a927d9c62f13ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f13f8 expref: 19 pid: 5813 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393125.609270:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787393125.609276:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3326:x1874217338452608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787393125.609284:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393125.609288:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de801531e00/0x19a927d9c62f13ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f13f8 expref: 19 pid: 5813 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.609295:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de801531e00/0x19a927d9c62f13ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f13f8 expref: 19 pid: 5813 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.609305:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393125.609331:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3326:x1874217338452608:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393125.609337:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787393125.609379:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338452608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787393125.609458:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338452736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787393125.609822:0:11046:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de8040d9c00/0x19a927d9c62f13d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d593 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393125.609835:0:11046:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de8040d9c00/0x19a927d9c62f13d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d593 expref: 12 pid: 5815 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393125.609865:0:11046:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8186b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11046:1874217338452864:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393125.609912:0:11046:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808873240 going to sleep for 11 seconds 00000100:00100000:3.0:1787393125.609926:0:11046:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8186b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11046:1874217338452096:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393125.609935:0:11046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de801531e00/0x19a927d9c62f13ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f13f8 expref: 18 pid: 5813 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393125.610077:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393125.610142:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338452480 00000100:00100000:2.0:1787393125.610146:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338452480 00000100:00100000:2.0:1787393125.610181:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787393125.610188:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:11046:x1874217338452480:12345-0@lo:104: 00010000:00010000:2.0:1787393125.610198:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de801531800/0x19a927d9c62f13dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f13e3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393125.610234:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787393125.610240:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:11046:x1874217338452480:12345-0@lo:104: Request processed in 53us (3673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393125.610246:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787393125.610426:0:11046:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8186b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11046:1874217338452224:0@lo:104: 00010000:00010000:3.0:1787393125.610442:0:11046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80761de00/0x19a927d9c62f13f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f13ea expref: 17 pid: 5814 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393125.610450:0:11046:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8186b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11046:1874217338452352:0@lo:104: 00000100:00100000:0.0:1787393125.610529:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319545088 00000100:00100000:0.0:1787393125.610533:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319545088 00010000:00010000:0.0:1787393125.610552:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f1414 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5cb expref: 13 pid: 5814 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393125.610673:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:0.0:1787393125.610681:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a168c4-2b38-4392-a418-7572b035c481+13:2356:x1874217319545088:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787393125.610702:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393125.610708:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f1414 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5cb expref: 13 pid: 5814 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.610720:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f1414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5cb expref: 13 pid: 5814 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.610733:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8040d9800/0x19a927d9c62f1414 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5cb expref: 13 pid: 5814 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.610744:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393125.610772:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a168c4-2b38-4392-a418-7572b035c481+12:2356:x1874217319545088:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 92us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393125.610779:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 27 00010000:00010000:1.0:1787393125.610865:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787393125.610872:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de801531800/0x19a927d9c62f13dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f13e3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393125.610880:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531800 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1787393125.610884:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de801531800/0x19a927d9c62f13dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f13e3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393125.610893:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de801531800/0x19a927d9c62f13dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f13e3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393125.610899:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de801531800/0x19a927d9c62f13dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f13e3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393125.610905:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787393125.610930:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de801531800/0x19a927d9c62f13dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f13e3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393125.610937:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787393125.610972:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de801531800/0x19a927d9c62f13dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f13e3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393125.610979:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de801531800/0x19a927d9c62f13dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f13e3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393125.610992:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393125.610994:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393125.610996:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393125.611012:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338452992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787393125.611043:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393125.611143:0:11046:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8186b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11046:1874217338452480:0@lo:104: 00000100:00100000:2.0:1787393125.611447:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338452992 00000100:00100000:2.0:1787393125.611452:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338452992 00010000:00010000:3.0:1787393125.611676:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de8029e3400/0x19a927d9c62f13e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f13dc expref: 17 pid: 5815 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393125.611736:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787393125.611751:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:3325:x1874217338452992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787393125.611760:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393125.611765:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de8029e3400/0x19a927d9c62f13e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f13dc expref: 17 pid: 5815 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393125.611776:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de8029e3400/0x19a927d9c62f13e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f13dc expref: 17 pid: 5815 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393125.611790:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8029e3400/0x19a927d9c62f13e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f13dc expref: 17 pid: 5815 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393125.611801:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393125.611914:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+16:3325:x1874217338452992:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393125.611922:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787393125.612116:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338452992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787393125.633192:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393125.633262:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319545216 00000100:00100000:0.0:1787393125.633271:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319545216 00010000:00010000:0.0:1787393125.633316:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de8040d9c00/0x19a927d9c62f13d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d593 expref: 12 pid: 5815 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393125.633355:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:0.0:1787393125.633372:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a168c4-2b38-4392-a418-7572b035c481+12:2355:x1874217319545216:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787393125.633386:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393125.633391:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de8040d9c00/0x19a927d9c62f13d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d593 expref: 12 pid: 5815 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.633403:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de8040d9c00/0x19a927d9c62f13d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d593 expref: 12 pid: 5815 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.633424:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1430 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.633444:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1430 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.633459:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1430 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.633465:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1430 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.633471:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1430 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.633478:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1430 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.633484:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531a00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393125.633488:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1430 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.633496:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1430 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.633504:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1430 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.633512:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393125.633561:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a168c4-2b38-4392-a418-7572b035c481+12:2355:x1874217319545216:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 198us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393125.633569:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 29 00010000:00010000:3.0:1787393125.638635:0:11046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8040d9c00/0x19a927d9c62f13d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d593 expref: 11 pid: 5815 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393125.638657:0:11046:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8186b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11046:1874217338452864:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393125.638692:0:11046:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1430 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.638809:0:11046:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1430 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.638834:0:11046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1430 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.638864:0:11046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de801531a00/0x19a927d9c62f1430 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393125.867620:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787393126.326600:0:6648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 15e12ae6-dd1f-41b4-a172-edb7633b42fc 00000020:00000080:3.0:1787393126.326609:0:6648:0:(genops.c:906:class_export_put()) final put ffff9de83f653800/15e12ae6-dd1f-41b4-a172-edb7633b42fc 00000020:00000080:2.0:1787393126.326797:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83f653800/15e12ae6-dd1f-41b4-a172-edb7633b42fc for lustre-OST0000 00000020:00000080:2.0:1787393126.327130:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de83f655000 for lustre-OST0000 00010000:00010000:2.0:1787393126.889393:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787393126.957007:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787393126.957015:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de834a79800 from 7 10000000:01000000:1.0:1787393126.957020:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787393126.957065:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f1437 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393126.957075:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f1437 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393126.957085:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f1437 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393126.957110:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338453120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787393126.957176:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393126.957249:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787393126.957273:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338453120 00000100:00100000:1.0:1787393126.957279:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338453120 00000100:00100000:1.0:1787393126.957321:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787393126.957337:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338453120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787393126.957349:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393126.957372:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f143e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f1437 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393126.957393:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f143e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f1437 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393126.957402:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f143e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1437 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393126.957410:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d9a00, rc 0) 00000100:00100000:1.0:1787393126.957445:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338453120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393126.957451:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787393126.957496:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338453120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787393126.957513:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f1437 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f143e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393126.957521:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f1437 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f143e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393126.957576:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338453248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393126.957599:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393126.957620:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787393126.957916:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338453248 00000100:00100000:2.0:1787393126.957922:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338453248 00000100:00100000:2.0:1787393126.957946:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787393126.957953:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338453248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787393126.958169:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338453248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 215us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393126.958176:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787393126.958478:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338453248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393126.958510:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338453376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787393126.958568:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393126.958589:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787393126.958702:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338453376 00000100:00100000:2.0:1787393126.958706:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338453376 00000100:00100000:2.0:1787393126.958739:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787393126.958748:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338453376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787393126.958908:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338453376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393126.958915:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787393126.958990:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338453376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787393126.961041:0:11080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787393126.965421:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787393126.965452:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787393126.965463:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f1437 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f143e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393126.965476:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f1437 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f143e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393126.965487:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787393126.965490:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de83d423000 from 7 10000000:01000000:2.0:1787393126.965493:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787393126.965527:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1445 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393126.965550:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1445 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393126.965618:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1445 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393126.965644:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338453504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787393126.965700:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393126.965771:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb59cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393126.965814:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338453504 00000100:00100000:1.0:1787393126.965821:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338453504 00000100:00100000:2.0:1787393126.966029:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787393126.966039:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338453504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787393126.966052:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393126.966063:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de800030800/0x19a927d9c62f144c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f1445 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393126.966085:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de800030800/0x19a927d9c62f144c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f1445 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393126.966095:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de800030800/0x19a927d9c62f144c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1445 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393126.966103:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800030800, rc 0) 00000100:00100000:2.0:1787393126.966173:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338453504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393126.966187:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787393126.966343:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338453504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787393126.966367:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1445 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f144c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393126.966376:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1445 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f144c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393126.966421:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338453632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393126.966447:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393126.966474:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787393126.966518:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338453632 00000100:00100000:2.0:1787393126.966522:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338453632 00000100:00100000:2.0:1787393126.966650:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787393126.966657:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338453632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787393126.966922:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338453632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393126.966929:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787393126.967114:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338453632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787393126.967144:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338453760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787393126.967296:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393126.967326:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393126.967374:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338453760 00000100:00100000:1.0:1787393126.967379:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338453760 00000100:00100000:1.0:1787393126.967412:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787393126.967420:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338453760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787393126.967675:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338453760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787393126.967939:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338453760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 519us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393126.967946:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000040:00080000:0.0:1787393126.969145:0:11081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787393126.969417:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787393126.969437:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787393126.969446:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1445 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f144c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393126.969464:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1445 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f144c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393126.969474:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787393126.969476:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de804ca6000 from 7 10000000:01000000:3.0:1787393126.969479:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787393126.969508:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f1453 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393126.969515:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f1453 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393126.969523:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f1453 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393126.969544:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8186b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338453888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787393126.969661:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393126.969719:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808873240 going to sleep for 11 seconds 00000100:00100000:0.0:1787393126.969751:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338453888 00000100:00100000:0.0:1787393126.969756:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338453888 00000100:00100000:0.0:1787393126.969828:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787393126.969933:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338453888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787393126.969945:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393126.969957:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80761c200/0x19a927d9c62f145a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f1453 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393126.969976:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761c200/0x19a927d9c62f145a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f1453 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393126.969985:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80761c200/0x19a927d9c62f145a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1453 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393126.969994:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761c200, rc 0) 00000100:00100000:0.0:1787393126.970066:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338453888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393126.970073:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787393126.970159:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8186b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338453888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787393126.970172:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f1453 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f145a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393126.970180:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f1453 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f145a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393126.970221:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8186b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338454016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787393126.970254:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393126.970312:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808873240 going to sleep for 11 seconds 00000100:00100000:0.0:1787393126.970401:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338454016 00000100:00100000:0.0:1787393126.970405:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338454016 00000100:00100000:0.0:1787393126.970471:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787393126.970478:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338454016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787393126.970708:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338454016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393126.970715:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787393126.970762:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8186b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338454016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787393126.970785:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8186b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338454144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787393126.970814:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393126.970995:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808873240 going to sleep for 11 seconds 00000100:00100000:2.0:1787393126.971051:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338454144 00000100:00100000:2.0:1787393126.971056:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338454144 00000100:00100000:2.0:1787393126.971077:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787393126.971083:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338454144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787393126.971232:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338454144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393126.971239:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787393126.971349:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8186b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338454144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787393126.972110:0:11082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787393126.972248:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787393126.972263:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787393126.972271:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f1453 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f145a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393126.972281:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f1453 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f145a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393127.065487:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393127.066473:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319545344 00000100:00100000:2.0:1787393127.066483:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319545344 00000100:00100000:2.0:1787393127.070433:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 235 00000100:00100000:2.0:1787393127.070453:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+11:5568:x1874217319545344:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787393127.070471:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393127.070488:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de800031800/0x19a927d9c62f1461 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d5f5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393127.070527:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de800031800/0x19a927d9c62f1461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5f5 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393127.070537:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de800031800/0x19a927d9c62f1461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5f5 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393127.070545:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800031800, rc 0) 00000100:00100000:2.0:1787393127.070603:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+12:5568:x1874217319545344:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 158us (5124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393127.070610:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 235 00000100:00100000:2.0:1787393127.078825:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393127.078928:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319545472 00000100:00100000:3.0:1787393127.078937:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319545472 00000100:00100000:3.0:1787393127.078992:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 236 00000100:00100000:3.0:1787393127.079002:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+12:5568:x1874217319545472:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787393127.079249:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+12:5568:x1874217319545472:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 248us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393127.079257:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 236 00000100:00100000:2.0:1787393127.081266:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393127.081335:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319545600 00000100:00100000:3.0:1787393127.081344:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319545600 00000100:00100000:3.0:1787393127.081404:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 237 00000100:00100000:3.0:1787393127.081414:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+12:5568:x1874217319545600:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787393127.081794:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+12:5568:x1874217319545600:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 Request processed in 379us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393127.081802:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 237 00000100:00100000:3.0:1787393127.087796:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393127.087989:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319545728 00000100:00100000:2.0:1787393127.088000:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319545728 00000100:00100000:2.0:1787393127.088050:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 238 00000100:00100000:2.0:1787393127.088059:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+12:5568:x1874217319545728:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787393127.088076:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393127.088092:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de800031c00/0x19a927d9c62f1468 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d5fc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393127.088117:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de800031c00/0x19a927d9c62f1468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5fc expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393127.088127:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de800031c00/0x19a927d9c62f1468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5fc expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393127.088136:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800031c00, rc 0) 00000100:00100000:2.0:1787393127.088203:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:5568:x1874217319545728:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 144us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393127.088210:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 238 00000100:00100000:0.0:1787393127.096631:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393127.096879:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319545856 00000100:00100000:3.0:1787393127.096889:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319545856 00000100:00100000:3.0:1787393127.096937:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 239 00000100:00100000:3.0:1787393127.096951:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:5568:x1874217319545856:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787393127.097209:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:5568:x1874217319545856:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 257us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393127.097216:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 239 00000100:00100000:1.0:1787393127.098548:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393127.107496:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319545984 00000100:00100000:3.0:1787393127.107510:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319545984 00000100:00100000:2.0:1787393127.107711:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 240 00000100:00100000:2.0:1787393127.107722:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:5568:x1874217319545984:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787393127.108194:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:5568:x1874217319545984:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 Request processed in 472us (9650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393127.108203:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 240 00000100:00100000:3.0:1787393127.254134:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393127.254215:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393127.256724:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319546240 00000100:00100000:0.0:1787393127.256738:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319546240 00000100:00100000:0.0:1787393127.257645:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319546112 00000100:00100000:0.0:1787393127.257652:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319546112 00000100:00100000:3.0:1787393127.257699:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 83 00000100:00100000:3.0:1787393127.257712:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319546240:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393127.257800:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319546240:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 90us (3674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393127.257807:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 83 00000100:00080000:2.0:1787393127.259626:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393127.259774:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 84 00000100:00100000:0.0:1787393127.259786:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319546112:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393127.259874:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319546112:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 90us (5659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393127.259881:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 84 00000100:00100000:0.0:1787393127.785963:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338454272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787393127.786039:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393127.786126:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338454272 00000100:00100000:0.0:1787393127.786133:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338454272 00000100:00100000:0.0:1787393127.786193:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787393127.786204:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338454272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787393127.786260:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393127.786308:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338454272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393127.786315:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1787393127.786337:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787393127.786378:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de834ecd500 x1874217338454272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393127.786398:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338454272:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787393127.914961:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393128.305724:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338454784:0@lo:400:kworker.0 00000100:00100000:0.0:1787393128.305793:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393128.305866:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787393128.305872:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338454400:0@lo:400:kworker.0 00000100:00100000:0.0:1787393128.305900:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393128.305922:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3326:1874217338454912:0@lo:400:kworker.0 00000100:00100000:0.0:1787393128.305946:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393128.305971:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338454528:0@lo:400:kworker.0 00000100:00100000:0.0:1787393128.305992:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393128.306008:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338455040:0@lo:400:kworker.0 00000100:00100000:0.0:1787393128.306027:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393128.306042:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787393128.306047:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338454656:0@lo:400:kworker.0 00000100:00100000:0.0:1787393128.306069:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393128.306098:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338454784 00000100:00100000:0.0:1787393128.306105:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338454784 00000100:00100000:0.0:1787393128.306144:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338455040 00000100:00100000:0.0:1787393128.306155:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338455040 00000100:00100000:0.0:1787393128.306187:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787393128.306195:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338454784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393128.306248:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338454784:12345-0@lo:400:kworker.0 Request processed in 53us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393128.306254:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787393128.306270:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787393128.306276:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338455040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393128.306306:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338455040:12345-0@lo:400:kworker.0 Request processed in 30us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393128.306312:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787393128.306330:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338454400 00000100:00100000:0.0:1787393128.306333:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338454400 00000100:00100000:0.0:1787393128.306369:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787393128.306376:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3326:x1874217338454400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393128.306404:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3326:x1874217338454400:12345-0@lo:400:kworker.0 Request processed in 29us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393128.306410:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787393128.306437:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338454912 00000100:00100000:0.0:1787393128.306441:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338454912 00000100:00100000:0.0:1787393128.306463:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338454528 00000100:00100000:0.0:1787393128.306466:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338454528 00000100:00100000:0.0:1787393128.306476:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338454656 00000100:00100000:0.0:1787393128.306478:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338454656 00000100:00100000:0.0:1787393128.306491:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787393128.306497:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1874217338454912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393128.306542:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1874217338454912:12345-0@lo:400:kworker.0 Request processed in 44us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393128.306554:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787393128.306566:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787393128.306571:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338454528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393128.306598:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338454528:12345-0@lo:400:kworker.0 Request processed in 28us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393128.306603:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787393128.306613:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787393128.306618:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338454656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393128.306642:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338454656:12345-0@lo:400:kworker.0 Request processed in 24us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393128.306648:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1787393128.306677:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787393128.306682:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787393128.306712:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338454656:0@lo:400:kworker.0 00000100:00100000:0.0:1787393128.306723:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338454528:0@lo:400:kworker.0 00010000:00080000:0.0:1787393128.306733:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de834ecfb80 x1874217338455040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393128.306743:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338455040:0@lo:400:kworker.0 00000100:00100000:0.0:1787393128.306772:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338454400:0@lo:400:kworker.0 00000100:00100000:0.0:1787393128.306782:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3326:1874217338454912:0@lo:400:kworker.0 00010000:00080000:0.0:1787393128.306792:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de834ecea00 x1874217338454784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393128.306799:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338454784:0@lo:400:kworker.0 00000100:00100000:0.0:1787393128.808979:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787393128.809002:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338455168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787393128.809067:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393128.809129:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338455168 00000100:00100000:0.0:1787393128.809137:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338455168 00000100:00100000:0.0:1787393128.809177:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787393128.809185:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338455168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787393128.809216:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393128.809259:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338455168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393128.809266:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1787393128.809425:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de834ecea00 x1874217338455168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393128.809444:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338455168:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787393128.939527:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787393129.721372:0:11246:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787393129.959955:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393130.985355:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393132.008088:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393132.379823:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393132.379893:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393132.379924:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393132.380006:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319546368 00000100:00100000:2.0:1787393132.380017:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319546368 00000100:00100000:2.0:1787393132.380070:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 242 00000100:00100000:2.0:1787393132.380079:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:2353:x1874217319546368:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393132.380142:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:2353:x1874217319546368:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 64us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393132.380149:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 242 00000100:00100000:0.0:1787393132.380672:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319546624 00000100:00100000:0.0:1787393132.380679:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319546624 00000100:00100000:0.0:1787393132.380789:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319546496 00000100:00100000:0.0:1787393132.380793:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319546496 00000100:00100000:1.0:1787393132.380873:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 88 00000100:00100000:1.0:1787393132.380883:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2353:x1874217319546624:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393132.380936:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2353:x1874217319546624:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 55us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393132.380944:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 88 00000100:00080000:2.0:1787393132.383659:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393132.386779:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 89 00000100:00100000:0.0:1787393132.386796:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2353:x1874217319546496:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393132.386909:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2353:x1874217319546496:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 118us (6983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393132.386917:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 89 00000100:00100000:2.0:1787393132.904075:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787393132.904099:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338455296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787393132.904167:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393132.904286:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338455296 00000100:00100000:0.0:1787393132.904294:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338455296 00000100:00100000:0.0:1787393132.904364:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787393132.904382:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338455296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787393132.904419:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393132.904465:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338455296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393132.904472:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787393132.906679:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787393132.906745:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83f5ac700 x1874217338455296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393132.906771:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338455296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787393133.036781:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393133.416020:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338455552:0@lo:400:kworker.0 00000100:00100000:0.0:1787393133.416097:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393133.416162:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787393133.416170:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338455680:0@lo:400:kworker.0 00000100:00100000:3.0:1787393133.416190:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3326:1874217338455808:0@lo:400:kworker.0 00000100:00100000:0.0:1787393133.416199:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393133.416201:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338455424:0@lo:400:kworker.0 00000100:00100000:3.0:1787393133.416233:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393133.416273:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393133.416346:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338455424 00000100:00100000:2.0:1787393133.416353:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338455424 00000100:00100000:2.0:1787393133.416398:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787393133.416402:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338455936:0@lo:400:kworker.0 00000100:00100000:2.0:1787393133.416410:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3327:x1874217338455424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393133.416435:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393133.416464:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3327:x1874217338455424:12345-0@lo:400:kworker.0 Request processed in 56us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393133.416473:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787393133.416494:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338455424:0@lo:400:kworker.0 00000100:00100000:1.0:1787393133.416566:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338455936 00000100:00100000:1.0:1787393133.416571:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338455936 00000100:00100000:1.0:1787393133.416605:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787393133.416612:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338455936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393133.416661:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338455936:12345-0@lo:400:kworker.0 Request processed in 50us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393133.416668:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787393133.418054:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338455552 00000100:00100000:0.0:1787393133.418064:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338455552 00000100:00100000:0.0:1787393133.418110:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338455680 00000100:00100000:0.0:1787393133.418114:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338455680 00000100:00100000:0.0:1787393133.418127:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338455808 00000100:00100000:0.0:1787393133.418130:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338455808 00000100:00100000:0.0:1787393133.418143:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787393133.418150:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338455552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393133.418207:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338455552:12345-0@lo:400:kworker.0 Request processed in 57us (2110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393133.418215:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787393133.418228:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787393133.418234:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338455680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393133.418259:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338455680:12345-0@lo:400:kworker.0 Request processed in 26us (2065us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393133.418264:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787393133.418274:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787393133.418286:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1874217338455808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393133.419581:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1874217338455808:12345-0@lo:400:kworker.0 Request processed in 1290us (3343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393133.419593:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787393133.419661:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3326:1874217338455808:0@lo:400:kworker.0 00000100:00100000:0.0:1787393133.419696:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338455680:0@lo:400:kworker.0 00000100:00100000:0.0:1787393133.419707:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338455552:0@lo:400:kworker.0 00000100:00080000:0.0:1787393133.419741:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787393133.419747:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787393133.423728:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de834ecd880 x1874217338455936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393133.424347:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338455936:0@lo:400:kworker.0 00000001:02000400:2.0:1787393133.640279:0:11345:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 06:05:32 (1787393132) === 00000100:00100000:2.0:1787393133.928197:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787393133.928223:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338456064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787393133.928297:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393133.928419:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338456064 00000100:00100000:1.0:1787393133.928429:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338456064 00000100:00100000:1.0:1787393133.928486:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787393133.928496:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338456064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787393133.928531:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393133.928581:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338456064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393133.928588:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787393133.928632:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83ca23b80 x1874217338456064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393133.928650:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338456064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787393133.940082:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393133.940281:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319546880 00000100:00100000:3.0:1787393133.940315:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319546880 00000100:00100000:3.0:1787393133.940384:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:3.0:1787393133.940412:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:9658:x1874217319546880:12345-192.168.203.21@tcp:700:mkdir.0 00000100:00100000:3.0:1787393133.940525:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:9658:x1874217319546880:12345-192.168.203.21@tcp:700:mkdir.0 Request processed in 109us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393133.940532:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:3.0:1787393133.941319:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393133.941422:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319546752 00000100:00100000:0.0:1787393133.941428:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319546752 00000100:00100000:0.0:1787393133.941512:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:0.0:1787393133.941521:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2356:x1874217319546752:12345-192.168.203.21@tcp:41:mkdir.0 00000004:00000024:0.0:1787393133.941574:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787393133.941690:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2356:x1874217319546752:12345-192.168.203.21@tcp:41:mkdir.0 Request processed in 169us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393133.941697:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:0.0:1787393133.943451:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393133.943522:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319547136 00000100:00100000:2.0:1787393133.943529:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319547136 00000100:00100000:2.0:1787393133.943579:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:2.0:1787393133.943588:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:9658:x1874217319547136:12345-192.168.203.21@tcp:36:mkdir.0 00010000:00010000:2.0:1787393133.943636:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393133.943666:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1350 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d57e expref: 6 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393133.943693:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de803da2600) 00010000:00010000:2.0:1787393133.943704:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787393133.944023:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f146f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393133.944036:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f146f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393133.944055:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f146f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393133.944078:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1476 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393133.944086:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1476 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393133.944093:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1476 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393133.946876:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787393133.946898:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f146f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393133.946910:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f146f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393133.946918:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f146f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393133.946925:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393133.946929:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f146f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393133.946938:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f146f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393133.946954:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:2.0:1787393133.946958:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393133.946969:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f146f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393133.946975:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f146f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787393133.946999:0:5820:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009a834f49 reply state 0000000010b38b7f transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1476 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393133.947009:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787393133.947123:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:9658:x1874217319547136:12345-192.168.203.21@tcp:36:mkdir.0 Request processed in 3532us (3673us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787393133.947133:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00010000:00010000:0.0:1787393133.953804:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1476 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393133.953823:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1476 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393133.953831:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1476 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393133.953959:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393133.953964:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1476 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393133.953972:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1476 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393133.953987:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9de818bd8500) 00010000:00010000:0.0:1787393133.953990:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393133.953994:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1476 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393133.954000:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1476 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393133.963353:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393133.963453:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319547264 00000100:00100000:1.0:1787393133.963464:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319547264 00000100:00100000:1.0:1787393133.963531:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:1.0:1787393133.963542:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:9659:x1874217319547264:12345-192.168.203.21@tcp:101:chmod.0 00010000:00010000:1.0:1787393133.963565:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393133.963592:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f147d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d603 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393133.963666:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f1484 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393133.963680:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f1484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393133.963693:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f1484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393133.963752:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787393133.963755:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393133.963797:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f1484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393133.963821:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f147d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d603 expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393133.963887:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f1484 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d603 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393133.963897:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:1.0:1787393133.963913:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787393133.963917:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d9800, rc 0) 00000100:00100000:1.0:1787393133.963983:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:9659:x1874217319547264:12345-192.168.203.21@tcp:101:chmod.0 Request processed in 443us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393133.963991:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:2.0:1787393133.978750:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393133.978912:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319547520 00000100:00100000:3.0:1787393133.978922:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319547520 00000100:00100000:3.0:1787393133.978982:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:3.0:1787393133.978993:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:9659:x1874217319547520:12345-192.168.203.21@tcp:36:chmod.0 00010000:00010000:3.0:1787393133.979043:0:10433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393133.979073:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f1484 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d603 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393133.979093:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:3.0:1787393133.979105:0:10433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787393133.979131:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f148b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393133.979143:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f148b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393133.979152:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f148b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787393133.979609:0:10433:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063d7bbb9 reply state 000000009814d348 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f148b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393133.979619:0:10433:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787393133.979635:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787393133.979723:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:9659:x1874217319547520:12345-192.168.203.21@tcp:36:chmod.0 Request processed in 732us (985us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787393133.979731:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00010000:00010000:1.0:1787393133.981776:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f148b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393133.981795:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f148b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393133.981802:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f148b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393133.981808:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393133.981813:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f148b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393133.981820:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f148b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393133.981836:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de8063dac00) 00010000:00010000:1.0:1787393133.981870:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787393133.981874:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f148b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393133.981879:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f148b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393134.015958:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393134.016071:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319547648 00000100:00100000:1.0:1787393134.016082:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319547648 00000100:00100000:1.0:1787393134.016157:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:1.0:1787393134.016184:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:9660:x1874217319547648:12345-192.168.203.21@tcp:101:chown.0 00010000:00010000:1.0:1787393134.016211:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393134.016235:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f1492 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d60a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.016315:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f1499 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.016330:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f1499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.016342:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f1499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393134.016404:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787393134.016408:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393134.016456:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f1499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.016483:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f1492 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d60a expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.016501:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f1499 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d60a expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.016510:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54b00) 00010000:00010000:1.0:1787393134.016513:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787393134.016516:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d9c00, rc 0) 00000100:00100000:1.0:1787393134.016577:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:9660:x1874217319547648:12345-192.168.203.21@tcp:101:chown.0 Request processed in 396us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393134.016593:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00080000:0.0:1787393134.017057:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393134.022916:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393134.022995:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319547776 00000100:00100000:1.0:1787393134.023006:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319547776 00000100:00100000:1.0:1787393134.023062:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:1.0:1787393134.023072:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:9660:x1874217319547776:12345-192.168.203.21@tcp:101:chown.0 00010000:00010000:1.0:1787393134.023093:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393134.023112:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f14a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d611 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023180:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f14a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023194:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f14a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023207:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f14a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023222:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f14ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023229:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f14ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023236:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f14ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023342:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f14b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023367:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f14b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023374:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f14b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393134.023415:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787393134.023419:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393134.023441:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f14b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023453:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f14a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023460:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f14a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023466:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f14a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023472:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393134.023476:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f14a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023482:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f14a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023493:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54b00) 00010000:00010000:1.0:1787393134.023496:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393134.023499:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f14a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023514:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f14a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023527:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f14ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023533:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f14ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023539:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f14ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023544:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393134.023546:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f14ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023552:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f14ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023559:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9de81aa54000) 00010000:00010000:1.0:1787393134.023561:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393134.023564:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f14ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023569:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f14ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023599:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f14a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d611 expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023611:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f14b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d611 expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.023675:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9de81aa54600) 00010000:00010000:1.0:1787393134.023679:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787393134.023682:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d9800, rc 0) 00000100:00100000:1.0:1787393134.023796:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:9660:x1874217319547776:12345-192.168.203.21@tcp:101:chown.0 Request processed in 724us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393134.023804:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:2.0:1787393134.031535:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393134.031619:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319548032 00000100:00100000:1.0:1787393134.031631:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319548032 00000100:00100000:1.0:1787393134.031695:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:1.0:1787393134.031705:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:9660:x1874217319548032:12345-192.168.203.21@tcp:36:chown.0 00010000:00010000:1.0:1787393134.031764:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393134.031791:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f14b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d611 expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.031809:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9de81aa54600) 00010000:00010000:1.0:1787393134.031820:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787393134.031884:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f14bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.031898:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f14bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.031907:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f14bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.057507:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1787393134.075456:0:5822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002459a801 reply state 00000000dc0fd8ea transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f14bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393134.075477:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787393134.075639:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787393134.075755:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:9660:x1874217319548032:12345-192.168.203.21@tcp:36:chown.0 Request processed in 44046us (44225us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787393134.075764:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 20 00000001:00080000:3.0:1787393134.075968:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:2.0:1787393134.076581:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f14bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.076592:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f14bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.076600:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f14bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.076616:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393134.076621:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f14bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.076629:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f14bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.076645:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9de81aa54000) 00010000:00010000:2.0:1787393134.076648:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787393134.076653:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f14bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.076660:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f14bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393134.099912:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393134.100049:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319548160 00000100:00100000:1.0:1787393134.100061:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319548160 00000100:00100000:1.0:1787393134.100133:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:1.0:1787393134.100143:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:9661:x1874217319548160:12345-192.168.203.21@tcp:101:touch.500 00010000:00010000:1.0:1787393134.100176:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393134.100204:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f14c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d618 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787393134.106387:0:5820:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6130us 00010000:00010000:2.0:1787393134.142250:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f14ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.142358:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f14ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.142372:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f14ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.142391:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f14d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.142397:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f14d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.142422:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f14d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.145502:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f14d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.145523:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f14d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.145536:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f14d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393134.145621:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787393134.145625:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787393134.145769:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f14d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.145779:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f14ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.145784:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f14ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.145788:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f14ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.145792:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393134.145794:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f14ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.145799:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f14ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.145813:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54b00) 00010000:00010000:2.0:1787393134.145815:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393134.145817:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f14ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.145896:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f14ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.145909:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f14d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.145916:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f14d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.145922:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f14d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.145927:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393134.145930:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f14d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.145937:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f14d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.145944:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9de818bd8000) 00010000:00010000:2.0:1787393134.145947:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393134.145950:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f14d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.145956:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f14d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.146008:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f14c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d618 expref: 8 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.146023:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f14d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d618 expref: 7 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.146030:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9de818bd8f00) 00010000:00010000:2.0:1787393134.146032:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787393134.146035:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4400, rc 0) 00000100:00100000:2.0:1787393134.146211:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:9661:x1874217319548160:12345-192.168.203.21@tcp:101:touch.500 Request processed in 46067us (46307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393134.146220:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:2.0:1787393134.152725:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393134.152971:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319548416 00000100:00100000:3.0:1787393134.152980:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319548416 00000100:00100000:3.0:1787393134.153044:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:3.0:1787393134.153054:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:9661:x1874217319548416:12345-192.168.203.21@tcp:101:touch.500 00010000:00010000:3.0:1787393134.153084:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393134.153103:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f14df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d61f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.153769:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f14e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.153785:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f14e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.153796:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f14e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.153881:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f14ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.153896:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f14ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.153904:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f14ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787393134.156251:0:5821:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787393134.156778:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f14f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.156794:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f14f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.156805:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f14f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.156989:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f14e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.156997:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f14e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.157003:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f14e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.157009:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393134.157014:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f14e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.157021:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f14e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.157047:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9de818bd8f00) 00010000:00010000:3.0:1787393134.157050:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393134.157055:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f14e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.157062:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f14e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787393134.157074:0:5821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ba64e495 reply state 00000000fa57a1e2 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f14ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393134.157157:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787393134.157195:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f14df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d61f expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.157210:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f14f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d61f expref: 9 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.157218:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:3.0:1787393134.157220:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787393134.157223:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531000, rc 0) 00000100:00100000:3.0:1787393134.157499:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:9661:x1874217319548416:12345-192.168.203.21@tcp:101:touch.500 Request processed in 4444us (4781us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787393134.157507:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 22 00010000:00010000:2.0:1787393134.166859:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f14ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.166879:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f14ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.166887:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f14ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.166894:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393134.166899:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f14ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.166906:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f14ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.166942:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff9de8063dae00) 00010000:00010000:2.0:1787393134.166945:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393134.166950:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f14ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.166956:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f14ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393134.171894:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393134.172115:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319548672 00000100:00100000:3.0:1787393134.172126:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319548672 00000100:00100000:3.0:1787393134.172191:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:3.0:1787393134.172201:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:9661:x1874217319548672:12345-192.168.203.21@tcp:36:touch.500 00010000:00010000:3.0:1787393134.172283:0:10433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393134.172320:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f14f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d61f expref: 9 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.172339:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:3.0:1787393134.172350:0:10433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787393134.172392:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1502 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.172405:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1502 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.172415:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1502 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787393134.172552:0:10433:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004af6ca89 reply state 000000005d95ac59 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1502 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393134.172561:0:10433:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787393134.172649:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:9661:x1874217319548672:12345-192.168.203.21@tcp:36:touch.500 Request processed in 449us (763us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787393134.172657:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 23 00010000:00010000:0.0:1787393134.178600:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1502 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393134.178611:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00010000:00010000:0.0:1787393134.178616:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1502 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393134.178623:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1502 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393134.178629:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393134.178634:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1502 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393134.178662:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1502 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393134.178679:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9de8063da400) 00010000:00010000:0.0:1787393134.178682:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393134.178687:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1502 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393134.178693:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1502 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393134.178922:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319548800 00000100:00100000:2.0:1787393134.178933:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319548800 00000100:00100000:2.0:1787393134.178979:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 24 00000100:00100000:2.0:1787393134.178989:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:9661:x1874217319548800:12345-192.168.203.21@tcp:101:touch.500 00010000:00010000:2.0:1787393134.179011:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393134.179027:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f1509 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d626 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.179092:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f1509 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d626 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.179105:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f1509 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d626 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.179123:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:2.0:1787393134.179125:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787393134.179128:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5a00, rc 0) 00000100:00100000:2.0:1787393134.179188:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:9661:x1874217319548800:12345-192.168.203.21@tcp:101:touch.500 Request processed in 200us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393134.179201:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 24 00000100:00100000:0.0:1787393134.183254:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393134.183346:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319548928 00000100:00100000:1.0:1787393134.183356:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319548928 00000100:00100000:1.0:1787393134.183402:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:1.0:1787393134.183411:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1874217319548928:12345-192.168.203.21@tcp:8:touch.500 00010000:00080000:1.0:1787393134.183452:0:6624:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:1.0:1787393134.183484:0:6624:0:(genops.c:1406:class_connect()) connect: client aab0ffcd-9aa3-4dc1-8a02-a1025323dd00, cookie 0x19a927d9c62f1510 00002000:00100000:1.0:1787393134.183494:0:6624:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aab0ffcd-9aa3-4dc1-8a02-a1025323dd00/ffff9de834cc5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366d ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787393134.183506:0:6624:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787393134.183745:0:6624:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787393134.183774:0:6624:0:(import.c:65:import_set_state_nolock()) ffff9de83f656000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787393134.183968:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2352:x1874217319548928:12345-192.168.203.21@tcp:8:touch.500 Request processed in 426us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393134.183977:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:1.0:1787393134.189926:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393134.190014:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319549056 00000100:00100000:0.0:1787393134.190025:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319549056 00000100:00100000:0.0:1787393134.190111:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:0.0:1787393134.190122:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:0:x1874217319549056:12345-192.168.203.21@tcp:2:touch.500 00000100:00080000:2.0:1787393134.191641:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787393134.284862:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:0:x1874217319549056:12345-192.168.203.21@tcp:2:touch.500 Request processed in 94709us (94911us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787393134.284877:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00000001:00080000:2.0:1787393134.285311:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1787393134.285328:0:6648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00000100:00100000:2.0:1787393134.303810:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393134.303946:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319549312 00000100:00100000:0.0:1787393134.303956:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319549312 00000100:00100000:0.0:1787393134.304020:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:0.0:1787393134.304030:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:9661:x1874217319549312:12345-192.168.203.21@tcp:35:touch.500 00000100:00100000:0.0:1787393134.304356:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+11:9661:x1874217319549312:12345-192.168.203.21@tcp:35:touch.500 Request processed in 326us (554us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787393134.304363:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:0.0:1787393134.332735:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393134.332822:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319549440 00000100:00100000:3.0:1787393134.332833:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319549440 00000100:00100000:3.0:1787393134.332931:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:3.0:1787393134.332941:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+11:9662:x1874217319549440:12345-192.168.203.21@tcp:101:rm.0 00010000:00010000:3.0:1787393134.332964:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393134.332987:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f1517 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d62d expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.333074:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f151e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.333087:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f151e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.333098:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f151e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393134.333153:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787393134.333157:0:10433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787393134.333192:0:10433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f151e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.333216:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f1517 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d62d expref: 13 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.333233:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f151e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d62d expref: 12 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.333242:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9de818bd8f00) 00010000:00010000:3.0:1787393134.333245:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787393134.333248:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531e00, rc 0) 00000100:00100000:3.0:1787393134.333330:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+12:9662:x1874217319549440:12345-192.168.203.21@tcp:101:rm.0 Request processed in 390us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393134.333337:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:1.0:1787393134.343516:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393134.343604:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319549696 00000100:00100000:2.0:1787393134.343615:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319549696 00000100:00100000:2.0:1787393134.343672:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 26 00000100:00100000:2.0:1787393134.343682:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+12:9662:x1874217319549696:12345-192.168.203.21@tcp:101:rm.0 00010000:00010000:2.0:1787393134.343703:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393134.343723:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1525 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d634 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393134.343873:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787393134.344057:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1525 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d634 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.344073:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54b00) 00010000:00010000:2.0:1787393134.344076:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787393134.344081:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1525 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d634 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.344094:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4200, rc 0) 00000100:00100000:2.0:1787393134.344148:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:9662:x1874217319549696:12345-192.168.203.21@tcp:101:rm.0 Request processed in 468us (642us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787393134.344155:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 26 00000100:00100000:1.0:1787393134.348418:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393134.348523:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319549824 00000100:00100000:0.0:1787393134.348533:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319549824 00000100:00100000:0.0:1787393134.348585:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:0.0:1787393134.348600:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:9662:x1874217319549824:12345-192.168.203.21@tcp:37:rm.0 00000100:00100000:2.0:1787393134.354075:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:9662:x1874217319549824:12345-192.168.203.21@tcp:37:rm.0 Request processed in 5463us (5653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393134.354096:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:1.0:1787393134.359761:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393134.359879:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319550080 00000100:00100000:3.0:1787393134.359889:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319550080 00000100:00100000:3.0:1787393134.359956:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:3.0:1787393134.359967:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818e68850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:9662:x1874217319550080:12345-192.168.203.21@tcp:35:rm.0 00000100:00100000:3.0:1787393134.360233:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818e68850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:9662:x1874217319550080:12345-192.168.203.21@tcp:35:rm.0 Request processed in 255us (467us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787393134.360242:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:1.0:1787393134.365662:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393134.365754:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319550336 00000100:00100000:3.0:1787393134.365765:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319550336 00000100:00100000:3.0:1787393134.365827:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:3.0:1787393134.365875:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:9662:x1874217319550336:12345-192.168.203.21@tcp:101:rm.0 00010000:00010000:3.0:1787393134.365901:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393134.365921:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f1533 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d63b expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.366038:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f153a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.366052:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f153a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.366064:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f153a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393134.366075:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787393134.366200:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f1533 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d63b expref: 17 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.366220:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f153a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d63b expref: 16 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393134.366437:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9de818bd8f00) 00010000:00010000:3.0:1787393134.366441:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787393134.366445:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531c00, rc 0) 00000100:00100000:3.0:1787393134.366621:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+16:9662:x1874217319550336:12345-192.168.203.21@tcp:101:rm.0 Request processed in 784us (970us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787393134.366629:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:0.0:1787393134.371603:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393134.371738:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319550464 00000100:00100000:2.0:1787393134.371749:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319550464 00000100:00100000:2.0:1787393134.371808:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:2.0:1787393134.371817:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+16:9662:x1874217319550464:12345-192.168.203.21@tcp:41:rm.0 00000004:00000024:2.0:1787393134.371912:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787393134.371988:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+16:9662:x1874217319550464:12345-192.168.203.21@tcp:41:rm.0 Request processed in 171us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393134.371995:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:1.0:1787393134.376334:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393134.376442:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319550592 00000100:00100000:2.0:1787393134.376452:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319550592 00000100:00100000:2.0:1787393134.376498:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:2.0:1787393134.376507:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+16:9662:x1874217319550592:12345-192.168.203.21@tcp:101:rm.0 00010000:00010000:2.0:1787393134.376525:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393134.376542:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1548 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d642 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376606:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f154f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376619:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f154f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376630:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f154f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376642:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1556 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376660:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1556 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376666:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1556 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376757:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f155d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376764:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f155d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376770:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f155d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393134.376793:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787393134.376797:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787393134.376811:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f155d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376822:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f155d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376829:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f154f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376835:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f154f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376863:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f154f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376887:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393134.376892:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f154f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376899:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f154f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376911:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9de818bd8f00) 00010000:00010000:2.0:1787393134.376914:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393134.376918:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f154f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376924:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f154f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376937:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1556 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376943:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1556 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376949:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1556 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376954:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393134.376956:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1556 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376962:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1556 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376977:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff9de818bd8400) 00010000:00010000:2.0:1787393134.376979:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393134.376982:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1556 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.376987:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1556 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.377256:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1548 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d642 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.377269:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f155d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d642 expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.377277:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:2.0:1787393134.377279:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787393134.377282:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4600, rc 0) 00000100:00100000:2.0:1787393134.377339:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+17:9662:x1874217319550592:12345-192.168.203.21@tcp:101:rm.0 Request processed in 833us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393134.377346:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:1.0:1787393134.382927:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393134.383167:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319550848 00000100:00100000:2.0:1787393134.383186:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319550848 00000100:00100000:2.0:1787393134.383235:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:2.0:1787393134.383244:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+17:9662:x1874217319550848:12345-192.168.203.21@tcp:36:rm.0 00010000:00010000:2.0:1787393134.383295:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787393134.383331:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f155d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d642 expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.383368:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f1509 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d626 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.383378:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:2.0:1787393134.383393:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f151e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d62d expref: 15 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.383402:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9de818bd8f00) 00010000:00010000:2.0:1787393134.383405:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787393134.383426:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1564 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.383449:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1564 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.383459:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1564 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.383472:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f156b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.383479:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f156b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.383485:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f156b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.383608:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1572 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.383626:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1572 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.383633:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1572 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787393134.384550:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787393134.384561:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 283559721061ns, next at 284559719107ns, rc = 0 00010000:00010000:2.0:1787393134.385785:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1579 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.385806:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.385817:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.385826:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1579 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.385833:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1579 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.385866:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1579 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.385892:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787393134.385912:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1572 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.385920:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1572 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.385937:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1572 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.385944:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393134.385948:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1572 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.385956:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1572 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.385969:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9de818bd8300) 00010000:00010000:2.0:1787393134.385972:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787393134.385976:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1572 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.385982:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1572 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.386755:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787393134.386762:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1579 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.386771:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4e00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:1.0:1787393134.386774:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1579 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.386781:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1579 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.386792:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9de818bd8300) 00010000:00010000:1.0:1787393134.386795:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787393134.386798:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1579 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.386804:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1579 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393134.386822:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393134.386824:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393134.386826:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393134.387108:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1564 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.387116:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1564 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.387122:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1564 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.387127:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393134.387131:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1564 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.387152:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1564 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.387162:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9de818bd8f00) 00010000:00010000:2.0:1787393134.387164:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393134.387167:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1564 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.387172:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1564 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787393134.387251:0:5822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b4763358 reply state 00000000c7bd3c9a transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f156b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393134.387260:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787393134.387364:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+16:9662:x1874217319550848:12345-192.168.203.21@tcp:36:rm.0 Request processed in 4116us (4442us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787393134.387373:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 30 00010000:00010000:2.0:1787393134.390821:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f156b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.390868:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f156b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.390877:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f156b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.390884:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393134.390889:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f156b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.390914:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f156b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.390930:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x94fd8476 (ffff9de818bd8400) 00010000:00010000:2.0:1787393134.390933:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393134.390937:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f156b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.390943:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f156b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x94fd8476 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393134.392383:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393134.392942:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319551104 00000100:00100000:3.0:1787393134.392953:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319551104 00000100:00100000:3.0:1787393134.393079:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:3.0:1787393134.393091:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:9662:x1874217319551104:12345-192.168.203.21@tcp:35:rm.0 00000100:00100000:3.0:1787393134.393418:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+16:9662:x1874217319551104:12345-192.168.203.21@tcp:35:rm.0 Request processed in 328us (1042us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787393134.393425:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:0.0:1787393134.396952:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393134.397045:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319551360 00000100:00100000:2.0:1787393134.397055:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319551360 00000100:00100000:2.0:1787393134.397107:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 31 00000100:00100000:2.0:1787393134.397117:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+16:9662:x1874217319551360:12345-192.168.203.21@tcp:36:rm.0 00010000:00010000:2.0:1787393134.397168:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787393134.397207:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f153a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d63b expref: 16 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.397229:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f14d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d618 expref: 15 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.397240:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9de818bd8f00) 00010000:00010000:2.0:1787393134.397255:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f1499 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d60a expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.397264:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54b00) 00010000:00010000:2.0:1787393134.397278:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787393134.397299:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f1580 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.398100:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f1580 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.398114:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f1580 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.398134:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1587 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.398142:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1587 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.398149:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1587 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.398737:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f158e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.398749:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f158e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.398757:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f158e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393134.401565:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787393134.401659:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f158e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.401669:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f158e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.401684:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f158e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.401690:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393134.401694:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f158e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.401702:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f158e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.401717:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:2.0:1787393134.401720:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787393134.401724:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f158e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.401729:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f158e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.401753:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f1580 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.401759:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f1580 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.401764:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f1580 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.401769:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393134.401771:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f1580 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.401785:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f1580 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.401793:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:2.0:1787393134.401795:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393134.401798:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f1580 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393134.401803:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f1580 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787393134.401815:0:5820:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d5a8cb91 reply state 00000000a0316955 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1587 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393134.401823:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787393134.401997:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:9662:x1874217319551360:12345-192.168.203.21@tcp:36:rm.0 Request processed in 4877us (5050us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787393134.402006:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 31 00010000:00010000:0.0:1787393134.409884:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1587 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393134.409903:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1587 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393134.409912:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1587 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393134.409919:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393134.409924:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1587 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393134.409932:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1587 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393134.409948:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9de818bd8a00) 00010000:00010000:0.0:1787393134.409951:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393134.409956:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1587 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393134.409962:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1587 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393135.080069:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393136.104618:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393137.127994:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393137.497751:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393137.497793:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393137.497834:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393137.497879:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319551744 00000100:00100000:0.0:1787393137.497889:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393137.497890:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319551744 00000100:00100000:0.0:1787393137.497937:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319551616 00000100:00100000:0.0:1787393137.497941:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319551616 00000100:00100000:2.0:1787393137.497949:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:2.0:1787393137.497958:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2355:x1874217319551744:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393137.497965:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319551872 00000100:00100000:0.0:1787393137.497967:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319551872 00000100:00100000:0.0:1787393137.497983:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 93 00000100:00100000:0.0:1787393137.497989:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:2355:x1874217319551616:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393137.498024:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2355:x1874217319551744:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 67us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393137.498031:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00080000:2.0:1787393137.498052:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787393137.498057:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787393137.498069:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 94 00000100:00100000:2.0:1787393137.498082:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319551872:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393137.498109:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319551488 00000100:00100000:3.0:1787393137.498113:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319551488 00000100:00100000:3.0:1787393137.498146:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 244 00000100:00100000:3.0:1787393137.498165:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319551488:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393137.500632:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:2355:x1874217319551616:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 2630us (2785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393137.500647:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 93 00000100:00100000:3.0:1787393137.503733:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319551488:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 5556us (5967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393137.503748:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 244 00000100:00100000:2.0:1787393137.504674:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319551872:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 6586us (6777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393137.504688:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 94 00000004:00080000:3.0:1787393138.024110:0:6770:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 287199268592ns, next at 288199266490ns, rc = 0 00000100:00100000:3.0:1787393138.024133:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787393138.024160:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8186b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338456192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787393138.024223:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393138.024523:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338456192 00000100:00100000:1.0:1787393138.024530:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338456192 00000100:00100000:1.0:1787393138.024591:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787393138.024601:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338456192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787393138.024640:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393138.025026:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338456192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 426us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393138.025034:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1787393138.025268:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de8186b0000 x1874217338456192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393138.025300:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8186b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338456192:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787393138.025425:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787393138.152923:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787393138.389200:0:11498:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1787393138.537239:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338456448:0@lo:400:kworker.0 00000100:00100000:1.0:1787393138.537257:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338456320:0@lo:400:kworker.0 00000100:00100000:0.0:1787393138.540298:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338456704:0@lo:400:kworker.0 00000100:00100000:0.0:1787393138.540355:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393138.540396:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393138.540418:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787393138.540427:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3325:1874217338456576:0@lo:400:kworker.0 00000100:00100000:0.0:1787393138.540454:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393138.540490:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338456704 00000100:00100000:0.0:1787393138.540498:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338456704 00000100:00100000:1.0:1787393138.540510:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338456832:0@lo:400:kworker.0 00000100:00100000:1.0:1787393138.540548:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393138.540549:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338456576 00000100:00100000:0.0:1787393138.540553:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338456576 00000100:00100000:0.0:1787393138.540582:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787393138.540588:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338456832 00000100:00100000:0.0:1787393138.540592:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338456704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393138.540594:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338456832 00000100:00100000:1.0:1787393138.540641:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787393138.540647:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338456704:12345-0@lo:400:kworker.0 Request processed in 56us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393138.540652:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338456832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393138.540794:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338456832:12345-0@lo:400:kworker.0 Request processed in 145us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393138.540799:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787393138.540806:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1787393138.540863:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83fccb800 x1874217338456832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393138.540915:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787393138.540924:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1874217338456576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393138.540948:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338456832:0@lo:400:kworker.0 00000100:00100000:0.0:1787393138.540956:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1874217338456576:12345-0@lo:400:kworker.0 Request processed in 33us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393138.540978:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1787393138.540998:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787393138.541003:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393138.541025:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3325:1874217338456576:0@lo:400:kworker.0 00000100:00100000:0.0:1787393138.541188:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338456704:0@lo:400:kworker.0 00000100:00100000:2.0:1787393138.541556:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338456320 00000100:00100000:2.0:1787393138.541562:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338456320 00000100:00100000:2.0:1787393138.541602:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787393138.541610:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3326:x1874217338456320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393138.541747:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3326:x1874217338456320:12345-0@lo:400:kworker.0 Request processed in 138us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393138.541754:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787393138.541783:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338456320:0@lo:400:kworker.0 00000100:00100000:3.0:1787393138.541943:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393138.542504:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338456448 00000100:00100000:0.0:1787393138.542509:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338456448 00000100:00100000:0.0:1787393138.542578:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787393138.542587:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338456448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393138.542641:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338456448:12345-0@lo:400:kworker.0 Request processed in 56us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393138.542647:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787393138.542717:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338456448:0@lo:400:kworker.0 00000100:00100000:1.0:1787393139.051265:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83d5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338456960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787393139.051342:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393139.052230:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338456960 00000100:00100000:2.0:1787393139.052240:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338456960 00000100:00100000:2.0:1787393139.052305:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787393139.052316:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338456960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787393139.052353:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393139.052411:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338456960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393139.052418:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787393139.053106:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83d5a9180 x1874217338456960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393139.053137:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83d5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338456960:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787393139.104381:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967302 is committed 00000001:00080000:3.0:1787393139.104682:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1787393139.104749:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787393139.104964:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338457088:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787393139.105039:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393139.105181:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338457088 00000100:00100000:3.0:1787393139.105189:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338457088 00000100:00100000:3.0:1787393139.105238:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787393139.105248:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338457088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787393139.105287:0:6624:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1787393139.105323:0:6624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a89746e, atime: 0x6a89746e, ctime: 0x6a89746e, blocks: 0x1 00010000:00010000:3.0:1787393139.105331:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076aa4c69/0x19a927d9c62f1595 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393139.105347:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=288s v=(0 0) 00010000:00010000:3.0:1787393139.105352:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393139.105358:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076aa4c69/0x19a927d9c62f1595 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393139.105375:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076aa4c69/0x19a927d9c62f1595 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393139.105386:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076aa4c69/0x19a927d9c62f1595 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393139.105464:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076aa4c69/0x19a927d9c62f1595 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393139.105483:0:6624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787393139.106220:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3324:x1874217338457088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 971us (1179us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787393139.106229:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787393139.106255:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393139.106262:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076aa4c69/0x19a927d9c62f1595 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393139.106282:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531000 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393139.106287:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076aa4c69/0x19a927d9c62f1595 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393139.106297:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076aa4c69/0x19a927d9c62f1595 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393139.106314:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076aa4c69/0x19a927d9c62f1595 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393139.106322:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076aa4c69/0x19a927d9c62f1595 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393139.106340:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393139.106347:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393139.106349:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787393139.106613:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:0.0:1787393139.107957:0:3324:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9de83f5ace00/2, rc 0, transno 4294967300 00000100:00100000:0.0:1787393139.107968:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338457088:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787393139.178821:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787393139.558080:0:11547:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe54399090 00000020:00000080:0.0:1787393139.558098:0:11547:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787393139.558104:0:11547:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787393139.558112:0:11547:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5439b320 20000000:00000080:0.0:1787393139.558119:0:11547:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9de83f693c00 uarg=0000000000000000 20000000:01000000:0.0:1787393139.558154:0:11547:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787393139.558160:0:11547:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787393139.558166:0:11547:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787393139.560910:0:11548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787393139.561012:0:11547:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787393139.573358:0:11547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787393139.573544:0:11547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787393139.573620:0:11547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787393139.573638:0:11547:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787393139.573658:0:11547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9de8186b4800/0x19a927d9c62f159c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.573678:0:11547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f143e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1437 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.573686:0:11547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de800030800/0x19a927d9c62f144c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1445 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.573692:0:11547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de80761c200/0x19a927d9c62f145a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f1453 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.573701:0:11547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de800031800/0x19a927d9c62f1461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5f5 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.573707:0:11547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de800031c00/0x19a927d9c62f1468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5fc expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.573713:0:11547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9de8186b4800/0x19a927d9c62f159c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.573752:0:11547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de800031c00/0x19a927d9c62f1468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5fc expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.573766:0:11547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de800031c00/0x19a927d9c62f1468 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5fc expref: 12 pid: 5815 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393139.573779:0:11547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1874217338457216:192.168.203.21@tcp:104: 00010000:00010000:2.0:1787393139.573894:0:11547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de800031800/0x19a927d9c62f1461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5f5 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.573908:0:11547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de800031800/0x19a927d9c62f1461 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5f5 expref: 12 pid: 5814 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393139.573918:0:11547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1874217338457344:192.168.203.21@tcp:104: 00010000:00010000:2.0:1787393139.573951:0:11547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de80761c200/0x19a927d9c62f145a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f1453 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.573960:0:11547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de80761c200/0x19a927d9c62f145a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f1453 expref: 18 pid: 5815 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393139.573969:0:11547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1874217338457472:0@lo:104: 00000100:00100000:2.0:1787393139.574005:0:11547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787393139.574034:0:11547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de800030800/0x19a927d9c62f144c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f1445 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.574042:0:11547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de800030800/0x19a927d9c62f144c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f1445 expref: 18 pid: 5815 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393139.574049:0:11547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1874217338457600:0@lo:104: 00000100:00100000:2.0:1787393139.574067:0:11547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393139.574089:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338457472 00000100:00100000:2.0:1787393139.574095:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338457472 00000100:00100000:2.0:1787393139.574125:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338457600 00000100:00100000:2.0:1787393139.574127:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338457600 00000100:00100000:2.0:1787393139.574139:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787393139.574151:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+4:11547:x1874217338457472:12345-0@lo:104: 00010000:00010000:2.0:1787393139.574164:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f1453 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f145a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.574224:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787393139.574231:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+4:11547:x1874217338457472:12345-0@lo:104: Request processed in 85us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393139.574239:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787393139.574255:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787393139.574261:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:11547:x1874217338457600:12345-0@lo:104: 00010000:00010000:2.0:1787393139.574277:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1445 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f144c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.574315:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787393139.574320:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28e76f01-627f-442b-bc98-cefaf6a7617a+3:11547:x1874217338457600:12345-0@lo:104: Request processed in 60us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393139.574325:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787393139.574342:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787393139.574348:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f1453 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f145a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.574355:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531600 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1787393139.574358:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f1453 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f145a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.574367:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f1453 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f145a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787393139.574373:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f1453 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f145a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393139.574379:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787393139.574427:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f1453 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f145a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.574434:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787393139.574453:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f1453 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f145a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.574459:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de801531600/0x19a927d9c62f1453 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f145a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.574472:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787393139.574476:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1445 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f144c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.574482:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800030c00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1787393139.574485:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1445 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f144c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.574492:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f144c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787393139.574498:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f144c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393139.574503:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787393139.574515:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1445 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f144c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.574520:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787393139.574531:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1445 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f144c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.574547:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de800030c00/0x19a927d9c62f1445 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f144c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.574557:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393139.574558:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393139.574560:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393139.574572:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338457728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787393139.574601:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393139.574642:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338457728 00000100:00100000:2.0:1787393139.574646:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338457728 00010000:00010000:2.0:1787393139.574663:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de80761c200/0x19a927d9c62f145a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1453 expref: 19 pid: 5815 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393139.574681:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787393139.574688:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338457728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787393139.574697:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393139.574702:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de80761c200/0x19a927d9c62f145a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1453 expref: 19 pid: 5815 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.574712:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de80761c200/0x19a927d9c62f145a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f1453 expref: 19 pid: 5815 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.574726:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393139.574752:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338457728:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393139.574759:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787393139.574792:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338457728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787393139.574834:0:11547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f143e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f1437 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.574866:0:11547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f143e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f1437 expref: 18 pid: 5813 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393139.574875:0:11547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1874217338457984:0@lo:104: 00000100:00100000:2.0:1787393139.574899:0:11547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393139.574912:0:11547:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351c29c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787393139.574925:0:11547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80761c200/0x19a927d9c62f145a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f1453 expref: 18 pid: 5815 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393139.574934:0:11547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1874217338457472:0@lo:104: 00000100:00100000:2.0:1787393139.574943:0:11547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1874217338457600:0@lo:104: 00010000:00010000:1.0:1787393139.577489:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393139.577517:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338457856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787393139.577583:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393139.577658:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338457856 00000100:00100000:1.0:1787393139.577665:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338457856 00010000:00010000:1.0:1787393139.577695:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de800030800/0x19a927d9c62f144c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1445 expref: 18 pid: 5815 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393139.577723:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787393139.577731:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:3326:x1874217338457856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787393139.577744:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393139.577749:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de800030800/0x19a927d9c62f144c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1445 expref: 18 pid: 5815 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393139.577759:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de800030800/0x19a927d9c62f144c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f1445 expref: 18 pid: 5815 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393139.577777:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de800030800/0x19a927d9c62f144c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f1445 expref: 18 pid: 5815 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393139.577787:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338457984 00010000:00010000:1.0:1787393139.577790:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393139.577791:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338457984 00000100:00100000:0.0:1787393139.577815:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787393139.577820:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+17:3326:x1874217338457856:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393139.577821:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f634c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+3:11547:x1874217338457984:12345-0@lo:104: 00000100:00100000:1.0:1787393139.577857:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1787393139.577866:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f1437 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f143e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393139.577895:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338457856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787393139.577907:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787393139.577912:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f634c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+3:11547:x1874217338457984:12345-0@lo:104: Request processed in 91us (3012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393139.577918:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787393139.578316:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787393139.578323:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f1437 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f143e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.578331:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8400 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1787393139.578335:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f1437 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f143e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.578343:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f1437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f143e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787393139.578349:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f1437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f143e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393139.578355:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787393139.578466:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f1437 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f143e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.578474:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787393139.578498:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f1437 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f143e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.578506:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8040d8400/0x19a927d9c62f1437 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f143e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.578520:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393139.578522:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393139.578523:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393139.578553:0:11547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1874217338457984:0@lo:104: 00000100:00100000:1.0:1787393139.579031:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338458112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787393139.579070:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393139.580682:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338458112 00000100:00100000:2.0:1787393139.580694:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338458112 00010000:00010000:2.0:1787393139.580735:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f143e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1437 expref: 17 pid: 5813 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393139.580773:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787393139.580780:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de826cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+17:3327:x1874217338458112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787393139.580793:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393139.580798:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f143e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f1437 expref: 17 pid: 5813 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.580807:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f143e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f1437 expref: 17 pid: 5813 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.580823:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8040d9a00/0x19a927d9c62f143e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f1437 expref: 17 pid: 5813 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393139.580866:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393139.580925:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de826cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+16:3327:x1874217338458112:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393139.580931:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787393139.581084:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338458112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787393139.582193:0:11547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1874217338457344:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393139.583024:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393139.583109:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393139.583136:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319552000 00000100:00100000:1.0:1787393139.583142:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319552000 00010000:00010000:1.0:1787393139.583170:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de800031800/0x19a927d9c62f1461 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5f5 expref: 13 pid: 5814 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393139.583195:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319552128 00000100:00100000:1.0:1787393139.583198:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319552128 00010000:00010000:1.0:1787393139.583209:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de800031c00/0x19a927d9c62f1468 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5fc expref: 14 pid: 5815 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393139.583223:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:1.0:1787393139.583230:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a168c4-2b38-4392-a418-7572b035c481+14:2355:x1874217319552000:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393139.583243:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393139.583247:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de800031800/0x19a927d9c62f1461 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5f5 expref: 14 pid: 5814 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393139.583258:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de800031800/0x19a927d9c62f1461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5f5 expref: 14 pid: 5814 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393139.583283:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de800031800/0x19a927d9c62f1461 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5f5 expref: 14 pid: 5814 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393139.583309:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393139.583356:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319552000:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 125us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393139.583365:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:1.0:1787393139.583381:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:1.0:1787393139.583388:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a168c4-2b38-4392-a418-7572b035c481+12:2356:x1874217319552128:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393139.583395:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393139.583399:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de800031c00/0x19a927d9c62f1468 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5fc expref: 12 pid: 5815 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393139.583408:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de800031c00/0x19a927d9c62f1468 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5fc expref: 12 pid: 5815 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393139.583420:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9de8186b4800/0x19a927d9c62f159c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393139.583428:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8186b4800/0x19a927d9c62f159c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393139.583443:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de8186b4800/0x19a927d9c62f159c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393139.583450:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de8186b4800/0x19a927d9c62f159c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393139.583457:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9de8186b4800/0x19a927d9c62f159c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393139.583464:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9de8186b4800/0x19a927d9c62f159c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393139.583476:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4800 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:1.0:1787393139.583481:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9de8186b4800/0x19a927d9c62f159c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393139.583488:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9de8186b4800/0x19a927d9c62f159c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393139.583497:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9de8186b4800/0x19a927d9c62f159c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393139.583506:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393139.583526:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a168c4-2b38-4392-a418-7572b035c481+12:2356:x1874217319552128:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 138us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393139.583532:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 34 00010000:00010000:3.0:1787393139.583700:0:11547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de800031c00/0x19a927d9c62f1468 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5fc expref: 11 pid: 5815 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393139.583711:0:11547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11547:1874217338457216:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393139.583751:0:11547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9de8186b4800/0x19a927d9c62f159c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393139.583760:0:11547:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9de8186b4800/0x19a927d9c62f159c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393139.583766:0:11547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9de8186b4800/0x19a927d9c62f159c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393139.589717:0:11547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8186b4800/0x19a927d9c62f159c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787393139.688508:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1787393140.200157:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787393140.840158:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787393140.840165:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de834a79800 from 7 10000000:01000000:0.0:1787393140.840171:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787393140.840224:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f15a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393140.840236:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f15a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393140.840273:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f15a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393140.840300:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83d5aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338458240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787393140.840366:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393140.840545:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338458240 00000100:00100000:3.0:1787393140.840553:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338458240 00000100:00100000:3.0:1787393140.840608:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787393140.840617:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+16:5818:x1874217338458240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787393140.840631:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393140.840644:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de801531000/0x19a927d9c62f15aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f15a3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393140.840667:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de801531000/0x19a927d9c62f15aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f15a3 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393140.840695:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de801531000/0x19a927d9c62f15aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f15a3 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393140.840704:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531000, rc 0) 00000100:00100000:3.0:1787393140.842491:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338458240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1867us (2116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393140.842503:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787393140.843613:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8181c5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787393140.843648:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83d5aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338458240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787393140.843669:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f15a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f15aa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393140.843679:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f15a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f15aa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393140.843766:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83d5aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338458368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787393140.843810:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393140.843825:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8181c5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787393140.843984:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338458368 00000100:00100000:2.0:1787393140.843992:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338458368 00000100:00100000:2.0:1787393140.844040:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787393140.844050:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338458368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787393140.845992:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338458368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1936us (2174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393140.846005:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787393140.847997:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83d5aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338458368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393140.848066:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338458496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787393140.848144:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393140.848578:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb38480 going to sleep for 11 seconds 00000100:00100000:3.0:1787393140.851582:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338458496 00000100:00100000:3.0:1787393140.851596:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338458496 00000100:00100000:3.0:1787393140.851663:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787393140.851672:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338458496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787393140.852634:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338458496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 958us (4486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393140.852646:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787393140.853556:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338458496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787393140.855951:0:11561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:11561:1874217338458624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393140.856036:0:11561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393140.856080:0:11561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb38300 going to sleep for 11 seconds 00000100:00100000:0.0:1787393140.856140:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338458624 00000100:00100000:0.0:1787393140.856147:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338458624 00000100:00100000:0.0:1787393140.856204:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787393140.856213:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+17:11561:x1874217338458624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787393140.856664:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+17:11561:x1874217338458624:12345-0@lo:502:llog_process_th.0 Request processed in 450us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393140.856672:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787393140.859661:0:11561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:11561:1874217338458624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787393140.859721:0:11561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787393140.859743:0:11561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393140.859745:0:11561:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787393140.859752:0:11561:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9de834a79800 00000020:00000080:1.0:1787393140.859755:0:11561:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787393140.859861:0:11561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:11561:1874217338458752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393140.859925:0:11561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393140.859967:0:11561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb38300 going to sleep for 11 seconds 00000100:00100000:3.0:1787393140.860151:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338458752 00000100:00100000:3.0:1787393140.860157:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338458752 00000100:00100000:3.0:1787393140.860216:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787393140.860225:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:11561:x1874217338458752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787393140.860480:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+17:11561:x1874217338458752:12345-0@lo:502:llog_process_th.0 Request processed in 253us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393140.860488:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787393140.863098:0:11561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:11561:1874217338458752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787393140.863140:0:11561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787393140.863149:0:11561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393140.863151:0:11561:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787393140.863157:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787393140.863233:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787393140.863272:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787393140.863283:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f15a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f15aa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393140.863293:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f15a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f15aa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393140.863303:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787393140.863306:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de83d423000 from 7 10000000:01000000:1.0:1787393140.863309:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787393140.863338:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393140.863346:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393140.863354:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393140.863379:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338458880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787393140.863445:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393140.863479:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb38300 going to sleep for 11 seconds 00000100:00100000:2.0:1787393140.863948:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338458880 00000100:00100000:2.0:1787393140.863955:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338458880 00000100:00100000:2.0:1787393140.863998:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787393140.864006:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+17:5818:x1874217338458880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787393140.864020:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393140.864034:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8186b5800/0x19a927d9c62f15b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f15b1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393140.864057:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8186b5800/0x19a927d9c62f15b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f15b1 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393140.864067:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8186b5800/0x19a927d9c62f15b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f15b1 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393140.864075:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5800, rc 0) 00000100:00100000:2.0:1787393140.864118:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338458880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393140.864131:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787393140.864170:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338458880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787393140.864181:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f15b8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393140.864189:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f15b8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393140.864234:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338459008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787393140.864272:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393140.870364:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351c2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787393140.876772:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338459008 00000100:00100000:1.0:1787393140.876787:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338459008 00000100:00100000:1.0:1787393140.876850:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787393140.876860:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338459008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393140.877138:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338459008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (12865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393140.877146:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787393140.877230:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338459008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393140.878486:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338459136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787393140.878548:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393140.878575:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb38300 going to sleep for 11 seconds 00000100:00100000:1.0:1787393140.878599:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338459136 00000100:00100000:1.0:1787393140.878605:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338459136 00000100:00100000:1.0:1787393140.878634:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787393140.878641:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338459136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787393140.878804:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338459136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393140.878812:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787393140.878873:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338459136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787393140.879066:0:11564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:11564:1874217338459264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393140.879107:0:11564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393140.879123:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338459264 00000100:00100000:1.0:1787393140.879127:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338459264 00000100:00100000:1.0:1787393140.879145:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787393140.879151:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+18:11564:x1874217338459264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787393140.881905:0:11564:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb38d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787393140.885950:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+18:11564:x1874217338459264:12345-0@lo:502:llog_process_th.0 Request processed in 6789us (6833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393140.885964:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787393140.887370:0:11564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:11564:1874217338459264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787393140.887584:0:11564:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787393140.887598:0:11564:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393140.887600:0:11564:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787393140.887606:0:11564:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9de83d423000 00000020:00000080:2.0:1787393140.887609:0:11564:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787393140.887702:0:11564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:11564:1874217338459392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787393140.887770:0:11564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393140.887805:0:11564:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351c2240 going to sleep for 11 seconds 00000100:00100000:3.0:1787393140.888528:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338459392 00000100:00100000:3.0:1787393140.888538:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338459392 00000100:00100000:3.0:1787393140.888589:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787393140.888597:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:11564:x1874217338459392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787393140.888818:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:11564:x1874217338459392:12345-0@lo:502:llog_process_th.0 Request processed in 221us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393140.888827:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787393140.889583:0:11564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:11564:1874217338459392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787393140.889620:0:11564:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787393140.889628:0:11564:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393140.889630:0:11564:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787393140.889635:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787393140.893943:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787393140.893978:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787393140.893990:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f15b8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393140.894003:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f15b8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393140.894014:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787393140.894017:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de804ca6000 from 7 10000000:01000000:1.0:1787393140.894020:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787393140.894057:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393140.894065:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393140.894075:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393140.894098:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338459520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787393140.894177:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393140.894222:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb38480 going to sleep for 11 seconds 00000100:00100000:0.0:1787393140.894957:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338459520 00000100:00100000:0.0:1787393140.894967:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338459520 00000100:00100000:0.0:1787393140.895008:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787393140.895016:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:5818:x1874217338459520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787393140.895034:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393140.895048:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80761cc00/0x19a927d9c62f15c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f15bf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393140.895071:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761cc00/0x19a927d9c62f15c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f15bf expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393140.895081:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80761cc00/0x19a927d9c62f15c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f15bf expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393140.895088:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761cc00, rc 0) 00000100:00100000:0.0:1787393140.895134:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338459520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393140.895147:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787393140.895421:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338459520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787393140.895437:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f15c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393140.895445:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f15c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393140.895501:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338459648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393140.895531:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393140.895563:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb38480 going to sleep for 11 seconds 00000100:00100000:0.0:1787393140.895663:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338459648 00000100:00100000:0.0:1787393140.895667:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338459648 00000100:00100000:0.0:1787393140.895696:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787393140.895703:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338459648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787393140.895971:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338459648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393140.895979:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787393140.896057:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83fcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338459648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787393140.896088:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8186b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338459776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787393140.896128:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393140.896156:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818157cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787393140.896252:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338459776 00000100:00100000:0.0:1787393140.896265:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338459776 00000100:00100000:0.0:1787393140.896296:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787393140.896303:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338459776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787393140.896605:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:5818:x1874217338459776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 302us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393140.896613:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787393140.896682:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8186b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28e76f01-627f-442b-bc98-cefaf6a7617a:5818:1874217338459776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787393140.901508:0:11565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8186b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:11565:1874217338459904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787393140.901593:0:11565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393140.901637:0:11565:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818157540 going to sleep for 11 seconds 00000100:00100000:0.0:1787393140.901860:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338459904 00000100:00100000:0.0:1787393140.901869:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338459904 00000100:00100000:0.0:1787393140.901915:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787393140.901924:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:11565:x1874217338459904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787393140.902134:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:11565:x1874217338459904:12345-0@lo:502:llog_process_th.0 Request processed in 210us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393140.902142:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787393140.902366:0:11565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8186b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:11565:1874217338459904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787393140.902403:0:11565:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787393140.902413:0:11565:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393140.902415:0:11565:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787393140.902423:0:11565:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9de804ca6000 00000020:00000080:3.0:1787393140.902426:0:11565:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787393140.902499:0:11565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8186b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:11565:1874217338460032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787393140.902540:0:11565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393140.902559:0:11565:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818157540 going to sleep for 11 seconds 00000100:00100000:0.0:1787393140.902655:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338460032 00000100:00100000:0.0:1787393140.902660:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338460032 00000100:00100000:0.0:1787393140.902690:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787393140.902697:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:11565:x1874217338460032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787393140.902818:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:11565:x1874217338460032:12345-0@lo:502:llog_process_th.0 Request processed in 121us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393140.902826:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787393140.905002:0:11565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8186b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28e76f01-627f-442b-bc98-cefaf6a7617a:11565:1874217338460032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787393140.905045:0:11565:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787393140.905055:0:11565:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393140.905057:0:11565:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787393140.905071:0:11565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787393140.906986:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787393140.907014:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787393140.907026:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f15c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393140.907038:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f15c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787393140.918382:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787393141.230395:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393141.596883:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393141.598078:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319552256 00000100:00100000:0.0:1787393141.598091:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319552256 00000100:00100000:0.0:1787393141.598159:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 261 00000100:00100000:0.0:1787393141.598171:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+11:5568:x1874217319552256:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787393141.598185:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393141.598202:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80761c600/0x19a927d9c62f15cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d649 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393141.598230:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761c600/0x19a927d9c62f15cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d649 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393141.598241:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80761c600/0x19a927d9c62f15cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d649 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393141.598250:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761c600, rc 0) 00000100:00100000:0.0:1787393141.598808:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+12:5568:x1874217319552256:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 368us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393141.598836:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 261 00000100:00100000:0.0:1787393141.605937:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393141.606307:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319552384 00000100:00100000:3.0:1787393141.606319:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319552384 00000100:00100000:3.0:1787393141.606377:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 262 00000100:00100000:3.0:1787393141.606387:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+12:5568:x1874217319552384:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787393141.607006:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+12:5568:x1874217319552384:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 617us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393141.607025:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 262 00000100:00100000:2.0:1787393141.614731:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393141.614899:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319552512 00000100:00100000:0.0:1787393141.614910:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319552512 00000100:00100000:0.0:1787393141.614961:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 263 00000100:00100000:0.0:1787393141.614971:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81aa90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+12:5568:x1874217319552512:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787393141.615205:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81aa90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+12:5568:x1874217319552512:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 Request processed in 234us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393141.615213:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 263 00000100:00100000:1.0:1787393141.619451:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393141.619833:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319552640 00000100:00100000:3.0:1787393141.620099:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319552640 00000100:00100000:3.0:1787393141.620146:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 264 00000100:00100000:3.0:1787393141.620156:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+12:9932:x1874217319552640:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787393141.620406:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+12:9932:x1874217319552640:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 250us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393141.620414:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 264 00000100:00100000:2.0:1787393141.630782:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393141.630938:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319552768 00000100:00100000:1.0:1787393141.630948:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319552768 00000100:00100000:1.0:1787393141.631002:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 265 00000100:00100000:1.0:1787393141.631012:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+12:9932:x1874217319552768:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787393141.631264:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+12:9932:x1874217319552768:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 244us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393141.631272:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 265 00000100:00100000:2.0:1787393141.648642:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393141.648901:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319552896 00000100:00100000:0.0:1787393141.648911:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319552896 00000100:00100000:0.0:1787393141.648965:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 266 00000100:00100000:0.0:1787393141.648975:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+12:5568:x1874217319552896:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787393141.648991:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393141.649007:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80761dc00/0x19a927d9c62f15d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d650 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393141.649035:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761dc00/0x19a927d9c62f15d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d650 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393141.649047:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80761dc00/0x19a927d9c62f15d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d650 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393141.649055:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761dc00, rc 0) 00000100:00100000:0.0:1787393141.649111:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:5568:x1874217319552896:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 137us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393141.649134:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 266 00000100:00100000:2.0:1787393141.652987:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393141.653071:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319553024 00000100:00100000:3.0:1787393141.653080:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319553024 00000100:00100000:3.0:1787393141.653130:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 267 00000100:00100000:3.0:1787393141.653139:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:5568:x1874217319553024:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787393141.653435:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:5568:x1874217319553024:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 296us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393141.653442:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 267 00000100:00100000:2.0:1787393141.657959:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393141.658045:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319553152 00000100:00100000:1.0:1787393141.658055:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319553152 00000100:00100000:1.0:1787393141.658110:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 268 00000100:00100000:1.0:1787393141.658120:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:5568:x1874217319553152:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787393141.658330:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:5568:x1874217319553152:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 Request processed in 210us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393141.658344:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 268 00000100:00100000:2.0:1787393141.664217:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393141.665513:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319553280 00000100:00100000:0.0:1787393141.665526:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319553280 00000100:00100000:0.0:1787393141.665598:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 269 00000100:00100000:0.0:1787393141.665609:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:9935:x1874217319553280:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787393141.665891:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:9935:x1874217319553280:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 282us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393141.665899:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 269 00000100:00100000:2.0:1787393141.676478:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393141.676660:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319553408 00000100:00100000:3.0:1787393141.676670:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319553408 00000100:00100000:3.0:1787393141.676765:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 270 00000100:00100000:3.0:1787393141.676791:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:9935:x1874217319553408:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787393141.677047:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:9935:x1874217319553408:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 258us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393141.677055:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 270 00000040:00080000:3.0:1787393141.928428:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787393142.248216:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393142.614632:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393142.614673:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393142.614705:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393142.614731:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393142.614762:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319553664 00000100:00100000:3.0:1787393142.614772:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319553664 00000100:00100000:0.0:1787393142.614777:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319553792 00000100:00100000:0.0:1787393142.614784:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319553792 00000100:00100000:3.0:1787393142.614835:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319553920 00000100:00100000:3.0:1787393142.614868:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319553920 00000100:00100000:0.0:1787393142.614882:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:0.0:1787393142.614894:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2353:x1874217319553792:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393142.614903:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 98 00000100:00100000:3.0:1787393142.614914:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2353:x1874217319553664:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393142.614959:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2353:x1874217319553792:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 68us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393142.614967:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:1.0:1787393142.614986:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319553536 00000100:00100000:1.0:1787393142.614991:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319553536 00000100:00100000:0.0:1787393142.614997:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 99 00000100:00100000:0.0:1787393142.615006:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2353:x1874217319553920:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393142.615028:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 271 00000100:00100000:1.0:1787393142.615202:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:2353:x1874217319553536:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393142.615660:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2353:x1874217319553664:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 747us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393142.615669:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 98 00000100:00080000:3.0:1787393142.615695:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787393142.615700:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393142.622894:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2353:x1874217319553920:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 7877us (8149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393142.622910:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 99 00000100:00100000:1.0:1787393142.626132:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:2353:x1874217319553536:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 10922us (11499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393142.626147:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 271 00000100:00100000:0.0:1787393143.144291:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787393143.144315:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8186b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338460160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787393143.144392:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393143.144823:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338460160 00000100:00100000:3.0:1787393143.144834:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338460160 00000100:00100000:3.0:1787393143.144915:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787393143.144925:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338460160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787393143.144959:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787393143.145021:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338460160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393143.145045:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1787393143.146803:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787393143.146881:0:3325:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1787393143.146890:0:3325:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9de83f5ace00, transno 4294967300 00000100:00100000:0.0:1787393143.146921:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8186b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338460160:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787393143.273437:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393143.656160:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338460288:0@lo:400:kworker.0 00000100:00100000:0.0:1787393143.656248:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393143.656358:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338460288 00000100:00100000:3.0:1787393143.656377:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338460288 00000100:00100000:3.0:1787393143.656427:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787393143.656436:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338460288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393143.656769:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338460672:0@lo:400:kworker.0 00000100:00100000:1.0:1787393143.656823:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393143.656905:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338460544:0@lo:400:kworker.0 00000100:00100000:1.0:1787393143.656932:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393143.656953:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787393143.656958:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338460416:0@lo:400:kworker.0 00000100:00100000:1.0:1787393143.656980:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393143.657018:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338460672 00000100:00100000:1.0:1787393143.657023:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338460672 00000100:00100000:1.0:1787393143.657056:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338460544 00000100:00100000:1.0:1787393143.657059:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338460544 00000100:00100000:1.0:1787393143.657071:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338460416 00000100:00100000:1.0:1787393143.657073:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338460416 00000100:00100000:1.0:1787393143.657087:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787393143.657094:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338460672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393143.657132:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338460672:12345-0@lo:400:kworker.0 Request processed in 38us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393143.657155:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787393143.657179:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787393143.657185:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338460544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393143.657220:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338460544:12345-0@lo:400:kworker.0 Request processed in 35us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393143.657226:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787393143.657248:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787393143.657255:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338460416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393143.657282:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338460416:12345-0@lo:400:kworker.0 Request processed in 28us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393143.657288:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787393143.657324:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338460416:0@lo:400:kworker.0 00000100:00100000:1.0:1787393143.657334:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338460544:0@lo:400:kworker.0 00000100:00100000:1.0:1787393143.657359:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338460672:0@lo:400:kworker.0 00000100:00080000:1.0:1787393143.657395:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393143.661100:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338460288:12345-0@lo:400:kworker.0 Request processed in 4655us (4851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393143.661114:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787393143.663508:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787393143.663529:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338460800:0@lo:400:kworker.0 00000100:00100000:1.0:1787393143.663606:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393143.663899:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338460800 00000100:00100000:2.0:1787393143.663909:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338460800 00000100:00100000:2.0:1787393143.663975:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787393143.663983:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338460800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393143.664045:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338460800:12345-0@lo:400:kworker.0 Request processed in 62us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393143.664052:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787393143.664090:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de82c8d3480 x1874217338460800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393143.664103:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338460800:0@lo:400:kworker.0 00000100:00080000:1.0:1787393143.664271:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787393143.665395:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338460288:0@lo:400:kworker.0 00000100:00100000:1.0:1787393144.171067:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83d5abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338460928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787393144.171147:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393144.171349:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338460928 00000100:00100000:0.0:1787393144.171356:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338460928 00000100:00100000:0.0:1787393144.171424:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787393144.171434:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338460928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787393144.171468:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393144.171514:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338460928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393144.171520:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1787393144.175720:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83d5abb80 x1874217338460928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393144.175748:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83d5abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338460928:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787393144.296129:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393145.320062:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393146.347618:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393147.368581:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393147.738244:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393147.738385:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393147.738497:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319554048 00000100:00100000:1.0:1787393147.738508:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319554048 00000100:00100000:3.0:1787393147.738532:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393147.738567:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 273 00000100:00100000:3.0:1787393147.738574:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393147.738583:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:2353:x1874217319554048:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393147.738600:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319554176 00000100:00100000:3.0:1787393147.738605:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319554176 00000100:00100000:3.0:1787393147.738641:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319554432 00000100:00100000:3.0:1787393147.738644:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319554432 00000100:00100000:1.0:1787393147.738654:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:2353:x1874217319554048:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 74us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393147.738664:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 273 00000100:00100000:3.0:1787393147.738671:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 103 00000100:00100000:3.0:1787393147.738689:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2353:x1874217319554176:12345-192.168.203.21@tcp:400:kworker.0 00000100:00080000:1.0:1787393147.738706:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393147.738722:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 104 00000100:00100000:3.0:1787393147.738727:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2353:x1874217319554176:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 48us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393147.738733:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2353:x1874217319554432:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393147.738740:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 103 00000100:00100000:1.0:1787393147.739482:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2353:x1874217319554432:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 749us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393147.739491:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 104 00000100:00100000:0.0:1787393147.743980:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319554304 00000100:00100000:0.0:1787393147.743994:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319554304 00000100:00100000:0.0:1787393147.744146:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:0.0:1787393147.744157:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2353:x1874217319554304:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393147.744252:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2353:x1874217319554304:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 96us (5866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393147.744261:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00080000:1.0:1787393147.751386:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787393148.269733:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787393148.269754:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338461056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787393148.269820:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393148.269909:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338461056 00000100:00100000:3.0:1787393148.269916:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338461056 00000100:00100000:3.0:1787393148.269981:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787393148.269989:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338461056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787393148.270020:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787393148.270061:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338461056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393148.270068:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787393148.270105:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787393148.270137:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338461056:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787393148.393973:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393148.776480:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338461568:0@lo:400:kworker.0 00000100:00100000:1.0:1787393148.776546:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393148.776609:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787393148.776615:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338461440:0@lo:400:kworker.0 00000100:00100000:1.0:1787393148.776638:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393148.776674:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338461568 00000100:00100000:1.0:1787393148.776681:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338461568 00000100:00100000:1.0:1787393148.776726:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338461440 00000100:00100000:1.0:1787393148.776729:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338461440 00000100:00100000:3.0:1787393148.776731:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787393148.776742:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874217338461568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393148.776761:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787393148.776766:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338461440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393148.776794:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874217338461568:12345-0@lo:400:kworker.0 Request processed in 54us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393148.776794:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338461440:12345-0@lo:400:kworker.0 Request processed in 27us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393148.776801:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787393148.776857:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338461184:0@lo:400:kworker.0 00000100:00100000:2.0:1787393148.776893:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393148.776917:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338461696:0@lo:400:kworker.0 00000100:00100000:2.0:1787393148.776941:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393148.776957:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787393148.776962:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338461312:0@lo:400:kworker.0 00000100:00100000:2.0:1787393148.776990:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393148.777008:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338461696 00000100:00100000:2.0:1787393148.777012:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338461696 00000100:00100000:2.0:1787393148.777041:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787393148.777047:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338461696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393148.777081:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338461696:12345-0@lo:400:kworker.0 Request processed in 34us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393148.777087:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787393148.777107:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338461312 00000100:00100000:2.0:1787393148.777110:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338461312 00000100:00080000:0.0:1787393148.777192:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787393148.777198:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393148.777242:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338461440:0@lo:400:kworker.0 00000100:00100000:0.0:1787393148.777252:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338461568:0@lo:400:kworker.0 00000100:00100000:0.0:1787393148.777296:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338461184 00000100:00100000:0.0:1787393148.777299:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338461184 00000100:00100000:0.0:1787393148.777325:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787393148.777331:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338461184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393148.777365:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338461184:12345-0@lo:400:kworker.0 Request processed in 34us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393148.777372:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787393148.777540:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338461184:0@lo:400:kworker.0 00010000:00080000:1.0:1787393148.777553:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de702a83100 x1874217338461696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393148.777562:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338461696:0@lo:400:kworker.0 00000100:00100000:3.0:1787393148.781590:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787393148.781966:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787393148.781984:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338461312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393148.782081:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338461312:12345-0@lo:400:kworker.0 Request processed in 105us (5089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393148.782088:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787393148.782179:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338461312:0@lo:400:kworker.0 00000100:00100000:2.0:1787393149.289016:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83d5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338461824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787393149.289086:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393149.289213:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338461824 00000100:00100000:0.0:1787393149.289222:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338461824 00000100:00100000:0.0:1787393149.289268:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787393149.289277:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338461824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787393149.289308:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393149.289354:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338461824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393149.289361:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787393149.289603:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83d5a9c00 x1874217338461824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393149.289622:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83d5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338461824:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787393149.418677:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393150.442287:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787393151.147458:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787393151.464206:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393152.488695:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393152.867698:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393152.867789:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393152.867828:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393152.867990:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319554688 00000100:00100000:2.0:1787393152.868000:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319554688 00000100:00100000:2.0:1787393152.868057:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319554944 00000100:00100000:2.0:1787393152.868060:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319554944 00000100:00100000:2.0:1787393152.868084:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 108 00000100:00100000:2.0:1787393152.868106:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2356:x1874217319554688:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393152.868190:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2356:x1874217319554688:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 85us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393152.868198:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 108 00000100:00100000:2.0:1787393152.868215:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 109 00000100:00100000:2.0:1787393152.868221:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2356:x1874217319554944:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393152.868247:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2356:x1874217319554944:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 26us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393152.868253:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 109 00000100:00080000:3.0:1787393152.869214:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393152.869314:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393152.869699:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319554816 00000100:00100000:2.0:1787393152.869706:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319554816 00000100:00100000:2.0:1787393152.869768:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:2.0:1787393152.869786:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2355:x1874217319554816:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393152.869874:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2355:x1874217319554816:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 97us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393152.869881:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00080000:3.0:1787393152.870078:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787393152.871446:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319554560 00000100:00100000:1.0:1787393152.871458:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319554560 00000100:00100000:1.0:1787393152.871565:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 275 00000100:00100000:1.0:1787393152.871575:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319554560:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393152.871647:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319554560:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 73us (3957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393152.871655:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 275 00000100:00100000:0.0:1787393153.384404:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338461952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787393153.384488:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393153.384689:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338461952 00000100:00100000:3.0:1787393153.384697:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338461952 00000100:00100000:3.0:1787393153.384756:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787393153.384766:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338461952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787393153.384800:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787393153.384869:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338461952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393153.384876:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787393153.384935:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338461952:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787393153.385000:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787393153.519320:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393153.899709:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83d5a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338462080:0@lo:400:kworker.0 00000100:00100000:1.0:1787393153.899788:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393153.899866:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83d5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338462592:0@lo:400:kworker.0 00000100:00100000:1.0:1787393153.899892:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393153.899929:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787393153.899935:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83d5a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338462464:0@lo:400:kworker.0 00000100:00100000:1.0:1787393153.899959:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393153.900079:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338462080 00000100:00100000:0.0:1787393153.900087:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338462080 00000100:00100000:0.0:1787393153.900139:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787393153.900149:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3327:x1874217338462080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393153.900216:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3327:x1874217338462080:12345-0@lo:400:kworker.0 Request processed in 68us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393153.900223:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787393153.902704:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83d5a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338462080:0@lo:400:kworker.0 00000100:00100000:2.0:1787393153.904120:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83d5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338462208:0@lo:400:kworker.0 00000100:00100000:2.0:1787393153.904206:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393153.904443:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83d5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338462720:0@lo:400:kworker.0 00000100:00100000:2.0:1787393153.904482:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393153.904581:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787393153.904591:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83d5a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338462336:0@lo:400:kworker.0 00000100:00100000:0.0:1787393153.904597:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338462592 00000100:00100000:0.0:1787393153.904615:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338462592 00000100:00100000:2.0:1787393153.904641:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393153.904687:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338462208 00000100:00100000:0.0:1787393153.904691:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338462208 00000100:00080000:1.0:1787393153.904742:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393153.904768:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338462336 00000100:00100000:1.0:1787393153.904772:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338462336 00000100:00100000:1.0:1787393153.904801:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787393153.904810:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874217338462592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393153.904908:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874217338462592:12345-0@lo:400:kworker.0 Request processed in 99us (5014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393153.904915:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787393153.904930:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787393153.904936:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338462336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393153.904966:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338462336:12345-0@lo:400:kworker.0 Request processed in 31us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393153.904972:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1787393153.904986:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393153.905014:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83d5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338462592:0@lo:400:kworker.0 00000100:00100000:0.0:1787393153.905648:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787393153.905657:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338462208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393153.905700:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338462208:12345-0@lo:400:kworker.0 Request processed in 45us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393153.905707:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787393153.905764:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83d5a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338462336:0@lo:400:kworker.0 00000100:00100000:0.0:1787393153.905777:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83d5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338462208:0@lo:400:kworker.0 00000100:00100000:3.0:1787393153.905930:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338462464 00000100:00100000:3.0:1787393153.905936:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338462464 00000100:00100000:3.0:1787393153.905973:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338462720 00000100:00100000:3.0:1787393153.905976:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338462720 00000100:00100000:3.0:1787393153.906060:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787393153.906068:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338462464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393153.906124:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338462464:12345-0@lo:400:kworker.0 Request processed in 56us (6163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393153.906130:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787393153.906143:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787393153.906149:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338462720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393153.906194:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338462720:12345-0@lo:400:kworker.0 Request processed in 45us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393153.906200:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787393153.906244:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83d5a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338462464:0@lo:400:kworker.0 00000100:00080000:1.0:1787393153.906537:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787393153.906718:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83d5a9c00 x1874217338462720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393153.906731:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83d5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338462720:0@lo:400:kworker.0 00000100:00100000:2.0:1787393154.408189:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83d5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338462848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787393154.408258:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393154.415375:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338462848 00000100:00100000:0.0:1787393154.415391:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338462848 00000100:00100000:0.0:1787393154.415475:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787393154.415485:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338462848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787393154.415524:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393154.415604:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338462848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (7344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393154.415611:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787393154.416387:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83d5a9c00 x1874217338462848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393154.416410:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83d5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338462848:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787393154.537562:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393155.560229:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393156.584196:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393157.608059:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393157.976150:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393157.976197:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393157.976287:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319555200 00000100:00100000:2.0:1787393157.976298:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319555200 00000100:00100000:2.0:1787393157.976375:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 113 00000100:00100000:2.0:1787393157.976386:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2353:x1874217319555200:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393157.976460:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2353:x1874217319555200:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 77us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393157.976468:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 113 00000100:00080000:3.0:1787393157.976625:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393157.976730:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319555072 00000100:00100000:1.0:1787393157.976734:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319555072 00000100:00100000:1.0:1787393157.976766:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 277 00000100:00100000:1.0:1787393157.976775:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:2353:x1874217319555072:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393157.976815:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:2353:x1874217319555072:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 42us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393157.976835:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 277 00000100:00100000:0.0:1787393157.999178:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393157.999223:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393157.999409:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319555328 00000100:00100000:3.0:1787393157.999419:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319555328 00000100:00100000:3.0:1787393157.999491:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:3.0:1787393157.999501:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2352:x1874217319555328:12345-192.168.203.21@tcp:9:kworker.0 00000020:00000080:3.0:1787393157.999543:0:6624:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1510 00000100:00080000:3.0:1787393157.999552:0:6624:0:(import.c:65:import_set_state_nolock()) ffff9de83f656000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787393157.999587:0:6624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1787393157.999866:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+2:2352:x1874217319555328:12345-192.168.203.21@tcp:9:kworker.0 Request processed in 337us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393157.999874:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00080000:1.0:1787393158.000145:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787393158.000157:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393158.000726:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319555456 00000100:00100000:2.0:1787393158.000734:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319555456 00000100:00100000:2.0:1787393158.000796:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 114 00000100:00100000:2.0:1787393158.000804:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2353:x1874217319555456:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393158.000888:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2353:x1874217319555456:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 85us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393158.000896:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 114 00000100:00080000:1.0:1787393158.001190:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787393158.504078:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787393158.504104:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338462976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787393158.504184:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393158.504208:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338462976 00000100:00100000:0.0:1787393158.504229:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338462976 00000100:00100000:0.0:1787393158.504284:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787393158.504295:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338462976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787393158.504330:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393158.504396:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338462976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393158.504406:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787393158.504467:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338462976:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787393158.504894:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787393158.633055:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393159.016126:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338463232:0@lo:400:kworker.0 00000100:00100000:3.0:1787393159.016216:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393159.016241:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3325:1874217338463360:0@lo:400:kworker.0 00000100:00100000:3.0:1787393159.016294:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338463744:0@lo:400:kworker.0 00000100:00100000:3.0:1787393159.016321:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393159.016518:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393159.016660:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338463744 00000100:00100000:2.0:1787393159.016660:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338463232 00000100:00100000:3.0:1787393159.016668:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338463744 00000100:00100000:2.0:1787393159.016668:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338463232 00000100:00100000:2.0:1787393159.016705:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338463360 00000100:00100000:2.0:1787393159.016708:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338463360 00000100:00100000:3.0:1787393159.016722:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787393159.016731:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338463744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393159.016735:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787393159.016739:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338463232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393159.016779:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338463232:12345-0@lo:400:kworker.0 Request processed in 39us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393159.016787:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787393159.016808:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787393159.016813:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1874217338463360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393159.016870:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338463744:12345-0@lo:400:kworker.0 Request processed in 140us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393159.016877:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1787393159.016934:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83f5adc00 x1874217338463744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393159.016946:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338463744:0@lo:400:kworker.0 00000100:00100000:3.0:1787393159.016956:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338463232:0@lo:400:kworker.0 00000100:00100000:0.0:1787393159.017034:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338463104:0@lo:400:kworker.0 00000100:00100000:0.0:1787393159.017068:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393159.017095:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338463616:0@lo:400:kworker.0 00000100:00100000:2.0:1787393159.017096:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1874217338463360:12345-0@lo:400:kworker.0 Request processed in 283us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393159.017103:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787393159.017117:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393159.017145:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787393159.017148:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338463104 00000100:00100000:2.0:1787393159.017151:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338463104 00000100:00100000:0.0:1787393159.017151:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338463488:0@lo:400:kworker.0 00000100:00100000:0.0:1787393159.017173:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393159.017187:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787393159.017194:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3327:x1874217338463104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393159.017196:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338463488 00000100:00100000:0.0:1787393159.017199:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338463488 00000100:00100000:0.0:1787393159.017222:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787393159.017225:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3327:x1874217338463104:12345-0@lo:400:kworker.0 Request processed in 33us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393159.017228:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338463488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393159.017232:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787393159.017277:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338463488:0@lo:400:kworker.0 00000100:00100000:2.0:1787393159.017411:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338463104:0@lo:400:kworker.0 00000100:00100000:2.0:1787393159.017440:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338463616 00000100:00100000:2.0:1787393159.017443:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338463616 00000100:00100000:2.0:1787393159.017468:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787393159.017474:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874217338463616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393159.018036:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3325:1874217338463360:0@lo:400:kworker.0 00000100:00080000:1.0:1787393159.018127:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787393159.018142:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787393159.019600:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874217338463616:12345-0@lo:400:kworker.0 Request processed in 2119us (2476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393159.019627:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787393159.019949:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338463616:0@lo:400:kworker.0 00000100:00100000:0.0:1787393159.020894:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338463488:12345-0@lo:400:kworker.0 Request processed in 3661us (3714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393159.020907:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787393159.529566:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83d5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338463872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787393159.529634:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393159.529820:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338463872 00000100:00100000:0.0:1787393159.529829:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338463872 00000100:00100000:0.0:1787393159.529891:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787393159.529899:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338463872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787393159.529946:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393159.529995:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338463872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393159.530003:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787393159.530099:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83d5a9c00 x1874217338463872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393175 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393159.530117:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83d5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338463872:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787393159.661510:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787393160.089204:0:6648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00000020:00000080:2.0:1787393160.089212:0:6648:0:(genops.c:906:class_export_put()) final put ffff9de834cc5800/aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00000020:00000080:0.0:1787393160.089342:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9de834cc5800/aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 for lustre-OST0000 00000020:00000080:0.0:1787393160.089473:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de83f656000 for lustre-OST0000 00010000:00010000:1.0:1787393160.695294:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787393161.386691:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787393161.705556:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393162.728547:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393163.101306:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393163.101352:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393163.101388:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393163.101524:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319555584 00000100:00100000:0.0:1787393163.101534:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319555584 00000100:00100000:0.0:1787393163.101589:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 279 00000100:00100000:0.0:1787393163.101599:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:2354:x1874217319555584:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393163.101668:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:2354:x1874217319555584:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 71us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393163.101675:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 279 00000100:00100000:1.0:1787393163.102001:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319555840 00000100:00100000:1.0:1787393163.102006:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319555840 00000100:00100000:1.0:1787393163.102047:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319555712 00000100:00100000:1.0:1787393163.102050:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319555712 00000100:00100000:1.0:1787393163.102071:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 118 00000100:00100000:1.0:1787393163.102079:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2354:x1874217319555840:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393163.102128:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2354:x1874217319555840:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 51us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393163.102134:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 118 00000100:00100000:1.0:1787393163.102148:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 119 00000100:00100000:1.0:1787393163.102155:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2354:x1874217319555712:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393163.102177:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2354:x1874217319555712:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 23us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393163.102182:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 119 00000100:00080000:0.0:1787393163.102436:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393163.625131:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787393163.625154:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338464000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787393163.625221:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393163.625295:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338464000 00000100:00100000:3.0:1787393163.625301:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338464000 00000100:00100000:3.0:1787393163.625349:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787393163.625358:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338464000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787393163.625392:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787393163.625455:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338464000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393163.625463:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1787393163.625483:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787393163.625514:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338464000:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787393163.752125:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787393164.062192:0:11728:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 06:06:02 (1787393162) 00000100:00100000:3.0:1787393164.143866:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338464128:0@lo:400:kworker.0 00000100:00100000:3.0:1787393164.143943:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393164.145197:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338464512:0@lo:400:kworker.0 00000100:00100000:0.0:1787393164.145252:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393164.145329:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338464512 00000100:00100000:0.0:1787393164.145336:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338464512 00000100:00100000:0.0:1787393164.145379:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787393164.145389:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338464512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393164.145438:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338464512:12345-0@lo:400:kworker.0 Request processed in 51us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393164.145446:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787393164.145486:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338464512:0@lo:400:kworker.0 00000100:00100000:2.0:1787393164.145691:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338464128 00000100:00100000:2.0:1787393164.145697:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338464128 00000100:00100000:2.0:1787393164.145724:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787393164.145731:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3327:x1874217338464128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393164.149546:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338464256:0@lo:400:kworker.0 00000100:00100000:1.0:1787393164.149610:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393164.149638:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338464768:0@lo:400:kworker.0 00000100:00100000:1.0:1787393164.149672:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393164.149693:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787393164.149699:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338464384:0@lo:400:kworker.0 00000100:00100000:1.0:1787393164.149718:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393164.149743:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787393164.149751:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3326:1874217338464640:0@lo:400:kworker.0 00000100:00100000:1.0:1787393164.149773:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393164.149800:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338464256 00000100:00100000:1.0:1787393164.149806:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338464256 00000100:00100000:1.0:1787393164.149864:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338464384 00000100:00100000:1.0:1787393164.149868:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338464384 00000100:00100000:1.0:1787393164.149891:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338464640 00000100:00100000:1.0:1787393164.149893:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338464640 00000100:00100000:1.0:1787393164.149908:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787393164.149916:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338464256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393164.149964:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338464256:12345-0@lo:400:kworker.0 Request processed in 48us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393164.150077:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787393164.150094:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787393164.150111:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338464384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393164.150143:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338464384:12345-0@lo:400:kworker.0 Request processed in 34us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393164.150161:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787393164.150174:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787393164.150180:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1874217338464640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393164.150238:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1874217338464640:12345-0@lo:400:kworker.0 Request processed in 58us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393164.150244:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787393164.150265:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338464768 00000100:00100000:1.0:1787393164.150269:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338464768 00000100:00100000:1.0:1787393164.150295:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787393164.150302:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338464768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393164.150458:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338464768:12345-0@lo:400:kworker.0 Request processed in 156us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393164.150465:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787393164.150489:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787393164.150493:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393164.150519:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338464384:0@lo:400:kworker.0 00000100:00100000:1.0:1787393164.150530:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338464256:0@lo:400:kworker.0 00010000:00080000:1.0:1787393164.150540:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83c63c000 x1874217338464768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787393180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393164.150549:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338464768:0@lo:400:kworker.0 00000100:00100000:1.0:1787393164.150579:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3326:1874217338464640:0@lo:400:kworker.0 00000100:00100000:2.0:1787393164.152717:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3327:x1874217338464128:12345-0@lo:400:kworker.0 Request processed in 6979us (8767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393164.152730:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787393164.153038:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338464128:0@lo:400:kworker.0 00000100:00100000:3.0:1787393164.648725:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787393164.648748:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83d5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338464896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787393164.648821:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393164.648990:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338464896 00000100:00100000:0.0:1787393164.649010:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338464896 00000100:00100000:0.0:1787393164.649074:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787393164.649084:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338464896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787393164.649126:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393164.649176:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338464896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393164.649183:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1787393164.649233:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83d5aaa00 x1874217338464896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393164.649254:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83d5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338464896:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787393164.776615:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393165.623150:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393165.623377:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319555968 00000100:00100000:1.0:1787393165.623387:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319555968 00000100:00100000:1.0:1787393165.623524:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00100000:1.0:1787393165.623535:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:10203:x1874217319555968:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787393165.623554:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393165.623578:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f15db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d657 expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.623641:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f15e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.623655:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f15e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.623669:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f15e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393165.623902:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787393165.623906:0:10433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393165.625263:0:10433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f15e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.625317:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f15db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d657 expref: 7 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.625338:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f15e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d657 expref: 6 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.625348:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de8184fc900) 00010000:00010000:1.0:1787393165.625351:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787393165.625354:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d9800, rc 0) 00000100:00100000:1.0:1787393165.625539:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:10203:x1874217319555968:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 2005us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393165.625561:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00080000:3.0:1787393165.631309:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787393165.646403:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393165.654190:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319556096 00000100:00100000:1.0:1787393165.654208:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319556096 00000100:00100000:1.0:1787393165.654287:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:1.0:1787393165.654307:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:10204:x1874217319556096:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787393165.654328:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393165.654351:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f15e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d65e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.654421:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f15f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.654435:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f15f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.654446:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f15f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.654460:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f15f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.654467:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f15f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.654473:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f15f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.654942:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8400/0x19a927d9c62f15fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.654974:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8400/0x19a927d9c62f15fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.654982:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8400/0x19a927d9c62f15fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393165.656274:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787393165.656283:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393165.656532:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8400/0x19a927d9c62f15fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.656547:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f15f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.656554:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f15f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.656561:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f15f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.656567:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393165.656571:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f15f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.656580:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f15f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.656595:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de8184fc900) 00010000:00010000:1.0:1787393165.656599:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393165.656603:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f15f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.656621:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f15f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.656637:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f15f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.656644:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f15f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.656649:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f15f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.656655:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393165.656658:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f15f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.656665:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f15f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.656673:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9de8184fca00) 00010000:00010000:1.0:1787393165.656676:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393165.656679:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f15f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.656685:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f15f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.656724:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f15e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d65e expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.656737:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8400/0x19a927d9c62f15fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d65e expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.656750:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9de8184fcf00) 00010000:00010000:1.0:1787393165.656752:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787393165.656755:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d8400, rc 0) 00000100:00100000:1.0:1787393165.657409:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:10204:x1874217319556096:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 3102us (11022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393165.657419:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:0.0:1787393165.679891:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393165.680000:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319556352 00000100:00100000:1.0:1787393165.680019:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319556352 00000100:00100000:1.0:1787393165.680077:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:1.0:1787393165.680098:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:10204:x1874217319556352:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787393165.680118:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393165.680138:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f1605 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d665 expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.680211:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f160c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.680224:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f160c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.680234:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f160c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.680304:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f1613 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.680312:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f1613 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.680333:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f1613 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.680907:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b200/0x19a927d9c62f161a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.680918:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b200/0x19a927d9c62f161a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.680925:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b200/0x19a927d9c62f161a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393165.680936:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787393165.681152:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f160c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.681161:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f160c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.681167:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f160c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.681173:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393165.681177:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f160c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.681185:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f160c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.681196:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9de8184fcf00) 00010000:00010000:1.0:1787393165.681200:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393165.681212:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f160c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.681218:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f160c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.681231:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f1613 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.681237:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f1613 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.681242:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f1613 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.681247:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393165.681249:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f1613 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.681255:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f1613 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.681263:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9de8184fca00) 00010000:00010000:1.0:1787393165.681265:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393165.681268:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f1613 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.681273:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9c00/0x19a927d9c62f1613 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.681644:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f1605 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d665 expref: 10 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.681672:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b200/0x19a927d9c62f161a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d665 expref: 9 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393165.681679:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9de8184fc100) 00010000:00010000:1.0:1787393165.681682:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393165.681683:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385b200, rc 0) 00000100:00100000:1.0:1787393165.681760:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:10204:x1874217319556352:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 1674us (1878us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787393165.681769:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:2.0:1787393165.691293:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393165.691509:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319556480 00000100:00100000:1.0:1787393165.691578:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319556480 00000100:00100000:1.0:1787393165.691671:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00100000:1.0:1787393165.691680:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:10204:x1874217319556480:12345-192.168.203.21@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787393165.691790:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:10204:x1874217319556480:12345-192.168.203.21@tcp:59:lhsmtool_posix.0 Request processed in 111us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393165.691797:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 35 00010000:00010000:1.0:1787393165.800113:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787393166.504631:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787393166.834762:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393167.815269:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393167.815336:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319556608 00000100:00100000:1.0:1787393167.815349:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319556608 00000100:00100000:1.0:1787393167.815418:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:1.0:1787393167.815429:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:10247:x1874217319556608:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393167.815450:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393167.816787:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1628 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d66c expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.816899:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f162f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.816912:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f162f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.816928:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f162f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.816943:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1636 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.816949:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1636 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.816956:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1636 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.817203:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f162f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.817211:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f162f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.817217:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f162f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.817225:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385ba00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393167.817229:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f162f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.817246:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f162f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.817258:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de8184fc900) 00010000:00010000:1.0:1787393167.817261:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393167.817266:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f162f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.817272:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f162f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.817285:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1636 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.817291:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1636 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.817296:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1636 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.817301:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385bc00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393167.817304:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1636 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.817310:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1636 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.817317:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9de81aa54c00) 00010000:00010000:1.0:1787393167.817320:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393167.817323:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1636 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.817339:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1636 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.817376:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1628 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d66c expref: 10 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.817386:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de8184fc900) 00010000:00010000:1.0:1787393167.817389:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393167.817392:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1628 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d66c expref: 10 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.817401:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385aa00, rc 0) 00000100:00100000:1.0:1787393167.817467:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:10247:x1874217319556608:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 2040us (2206us total) trans 0 rc 301/301 00000100:00100000:1.0:1787393167.817476:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00080000:3.0:1787393167.818120:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787393167.825331:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393167.825396:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319556864 00000100:00100000:3.0:1787393167.825405:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319556864 00000100:00100000:3.0:1787393167.825462:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:3.0:1787393167.825480:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:10247:x1874217319556864:12345-192.168.203.21@tcp:36:lfs.0 00010000:00010000:3.0:1787393167.825533:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393167.825559:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9800/0x19a927d9c62f15e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d657 expref: 9 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.825577:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de8184fc900) 00010000:00010000:3.0:1787393167.825587:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787393167.825891:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f163d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.825904:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f163d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.825914:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f163d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.825926:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1644 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.825932:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1644 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.825939:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1644 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393167.826880:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787393167.826892:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f163d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.826901:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f163d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.826919:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f163d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.826925:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393167.826930:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f163d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.826938:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f163d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.826950:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de8063dac00) 00010000:00010000:3.0:1787393167.826953:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393167.826956:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f163d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.826963:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f163d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787393167.826980:0:5822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f47b771d reply state 000000008092bd20 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1644 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393167.826988:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787393167.827097:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:10247:x1874217319556864:12345-192.168.203.21@tcp:36:lfs.0 Request processed in 1616us (1772us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787393167.827106:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 37 00010000:00010000:2.0:1787393167.833244:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1644 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.833272:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1644 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.833280:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1644 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.833286:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393167.833290:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1644 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.833298:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1644 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.833317:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9de8063dae00) 00010000:00010000:2.0:1787393167.833321:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393167.833325:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1644 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.833331:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1644 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393167.849483:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393167.913680:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393167.913778:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319556992 00000100:00100000:1.0:1787393167.913793:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319556992 00000100:00100000:1.0:1787393167.913877:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00100000:1.0:1787393167.913888:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:10255:x1874217319556992:12345-192.168.203.21@tcp:101:lctl.0 00010000:00010000:1.0:1787393167.913912:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393167.913934:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f164b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d673 expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.913999:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1652 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.914013:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1652 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.914040:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1652 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393167.914112:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787393167.914116:0:10433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393167.914154:0:10433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1652 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.914177:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f164b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d673 expref: 11 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.916618:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1652 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d673 expref: 10 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.916636:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54c00) 00010000:00010000:1.0:1787393167.916643:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787393167.916646:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385bc00, rc 0) 00000100:00100000:1.0:1787393167.916720:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:10255:x1874217319556992:12345-192.168.203.21@tcp:101:lctl.0 Request processed in 2833us (3049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393167.916729:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00100000:2.0:1787393167.975657:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393167.975752:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319557120 00000100:00100000:3.0:1787393167.975763:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319557120 00000100:00100000:3.0:1787393167.975824:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:3.0:1787393167.975835:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:10261:x1874217319557120:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1787393167.975907:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393167.975928:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1659 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d67a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.976008:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1660 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.976022:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1660 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.976033:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1660 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.976048:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1667 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.976054:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1667 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393167.976060:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1667 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.976793:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4a00/0x19a927d9c62f166e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.976804:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4a00/0x19a927d9c62f166e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.976812:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4a00/0x19a927d9c62f166e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393167.976961:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787393167.976965:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787393167.977005:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4a00/0x19a927d9c62f166e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.977019:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1660 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.977026:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1660 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.977033:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1660 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.977038:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393167.977042:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1660 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.977048:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1660 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.977060:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54c00) 00010000:00010000:2.0:1787393167.977063:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393167.977067:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1660 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.977081:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1660 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.977095:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1667 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.977112:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1667 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.977117:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1667 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.977122:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393167.977125:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1667 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.977131:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1667 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.977139:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9de8063dac00) 00010000:00010000:2.0:1787393167.977142:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393167.977144:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1667 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.977150:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1667 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.977187:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1659 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d67a expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.977214:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4a00/0x19a927d9c62f166e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d67a expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.977222:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:2.0:1787393167.977224:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787393167.977233:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4a00, rc 0) 00000100:00100000:2.0:1787393167.977302:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+11:10261:x1874217319557120:12345-192.168.203.21@tcp:101:bash.0 Request processed in 1468us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393167.977563:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:2.0:1787393167.982795:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393167.982891:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319557376 00000100:00100000:1.0:1787393167.982902:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319557376 00000100:00100000:1.0:1787393167.982964:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 40 00000100:00100000:1.0:1787393167.982974:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+11:10261:x1874217319557376:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:1.0:1787393167.982993:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393167.983013:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1675 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d681 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.983178:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f167c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.983193:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f167c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.983213:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f167c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.983275:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1683 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.983282:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1683 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.983289:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1683 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787393167.983888:0:5820:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787393167.984052:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f168a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.984061:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f168a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.984084:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f168a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.984120:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f167c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.984137:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f167c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.984143:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f167c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.984149:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385ba00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393167.984153:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f167c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.984161:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f167c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.984173:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:1.0:1787393167.984176:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393167.984181:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f167c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.984187:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f167c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787393167.984200:0:5820:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000187dc57a reply state 0000000036b606f5 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1683 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393167.984210:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787393167.984241:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1675 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d681 expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.984255:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f168a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d681 expref: 13 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393167.984274:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54b00) 00010000:00010000:1.0:1787393167.984276:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393167.984279:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385be00, rc 0) 00000100:00100000:1.0:1787393167.984358:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:10261:x1874217319557376:12345-192.168.203.21@tcp:101:bash.0 Request processed in 1385us (1573us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787393167.984367:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 40 00010000:00010000:2.0:1787393167.987747:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1683 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.987764:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1683 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.987772:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1683 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.987777:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393167.987783:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1683 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.987790:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1683 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.987806:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de81aa54300) 00010000:00010000:2.0:1787393167.987809:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393167.987814:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1683 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.987820:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1683 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393167.991514:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393167.991887:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319557504 00000100:00100000:0.0:1787393167.991899:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319557504 00000100:00100000:0.0:1787393167.991948:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:0.0:1787393167.991958:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874217319557504:12345-192.168.203.21@tcp:8:bash.0 00010000:00080000:0.0:1787393167.991993:0:6622:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp t0 exp 0000000000000000 cur 317 last 0 00000020:00000080:0.0:1787393167.992025:0:6622:0:(genops.c:1406:class_connect()) connect: client aab0ffcd-9aa3-4dc1-8a02-a1025323dd00, cookie 0x19a927d9c62f1698 00002000:00100000:0.0:1787393167.992037:0:6622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aab0ffcd-9aa3-4dc1-8a02-a1025323dd00/ffff9de805480000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366d ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787393167.992060:0:6622:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787393167.992353:0:6622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787393167.992384:0:6622:0:(import.c:65:import_set_state_nolock()) ffff9de805487800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787393167.992616:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2352:x1874217319557504:12345-192.168.203.21@tcp:8:bash.0 Request processed in 657us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393167.992625:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:3.0:1787393167.995811:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393167.996120:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319557632 00000100:00100000:2.0:1787393167.996145:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319557632 00000100:00100000:2.0:1787393167.996221:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:2.0:1787393167.996232:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:0:x1874217319557632:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1787393167.996248:0:7525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393167.996269:0:7525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb54295e/0x19a927d9c62f169f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d688 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787393167.996298:0:7525:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787393167.996316:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=317s v=(0 0) 00010000:00010000:2.0:1787393167.996320:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787393167.996330:0:7525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb54295e/0x19a927d9c62f169f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d688 expref: 7 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.996349:0:7525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb54295e/0x19a927d9c62f169f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d688 expref: 7 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393167.996362:0:7525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5c00, rc 0) 00000100:00080000:0.0:1787393167.996443:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787393167.996910:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:0:x1874217319557632:12345-192.168.203.21@tcp:101:bash.0 Request processed in 679us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393167.996919:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:3.0:1787393168.000406:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393168.000520:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319557760 00000100:00100000:0.0:1787393168.000531:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319557760 00000100:00100000:0.0:1787393168.000586:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:0.0:1787393168.000596:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:10261:x1874217319557760:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:0.0:1787393168.000614:0:6625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393168.000636:0:6625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9af08ef/0x19a927d9c62f16a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d68f expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.000665:0:6625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb54295e/0x19a927d9c62f169f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d688 expref: 8 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.000674:0:6625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393168.000678:0:6625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393168.000683:0:6625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9af08ef/0x19a927d9c62f16a6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d68f expref: 8 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.000715:0:6625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb54295e/0x19a927d9c62f169f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d688 expref: 8 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.000727:0:6625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb54295e/0x19a927d9c62f169f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d688 expref: 8 pid: 7525 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393168.000741:0:6625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83d5a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6625:1874217338465024:192.168.203.21@tcp:104: 00000100:00100000:0.0:1787393168.000863:0:6625:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de701b71300 going to sleep for 11 seconds 00000100:00100000:1.0:1787393168.003904:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393168.004019:0:6625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83d5a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6625:1874217338465024:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787393168.004068:0:6625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9af08ef/0x19a927d9c62f16a6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d68f expref: 8 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.004098:0:6625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761c200, rc 0) 00000100:00100000:0.0:1787393168.004163:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:10261:x1874217319557760:12345-192.168.203.21@tcp:101:bash.0 Request processed in 3569us (3766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393168.004173:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:2.0:1787393168.004778:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319557888 00000100:00100000:2.0:1787393168.004786:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319557888 00010000:00010000:2.0:1787393168.004822:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb54295e/0x19a927d9c62f169f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d688 expref: 8 pid: 7525 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393168.004888:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00100000:2.0:1787393168.004898:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810336d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2355:x1874217319557888:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393168.004922:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393168.004951:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb54295e/0x19a927d9c62f169f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d688 expref: 8 pid: 7525 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.004974:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb54295e/0x19a927d9c62f169f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d688 expref: 8 pid: 7525 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.005027:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb54295e/0x19a927d9c62f169f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d688 expref: 8 pid: 7525 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.005042:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787393168.005047:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787393168.005056:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9af08ef/0x19a927d9c62f16a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d68f expref: 7 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.005066:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9af08ef/0x19a927d9c62f16a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d68f expref: 7 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.005118:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e9af08ef/0x19a927d9c62f16a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d68f expref: 7 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393168.005132:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c687100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5807:1874217338465152:192.168.203.21@tcp:105: 00000100:00100000:2.0:1787393168.005793:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808f73f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787393168.009994:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c687100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5807:1874217338465152:192.168.203.21@tcp:105: 00010000:00010000:0.0:1787393168.010022:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393168.010574:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810336d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2355:x1874217319557888:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 5673us (6675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393168.010585:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00100000:0.0:1787393168.012029:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393168.013009:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319558144 00000100:00100000:1.0:1787393168.013021:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319558144 00000100:00100000:1.0:1787393168.013122:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:1.0:1787393168.013133:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:10261:x1874217319558144:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:1.0:1787393168.013536:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:10261:x1874217319558144:12345-192.168.203.21@tcp:35:bash.0 Request processed in 403us (1512us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787393168.013545:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:0.0:1787393168.091907:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393168.092001:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319558400 00000100:00100000:1.0:1787393168.092011:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319558400 00000100:00100000:1.0:1787393168.092081:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00100000:1.0:1787393168.092092:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:10271:x1874217319558400:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393168.092117:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393168.092137:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f16ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d696 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393168.092288:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787393168.092424:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f16ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d696 expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.092458:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54c00) 00010000:00010000:1.0:1787393168.092461:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787393168.092466:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f16ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d696 expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.092482:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385ba00, rc 0) 00000100:00100000:1.0:1787393168.092546:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:10271:x1874217319558400:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 455us (648us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1787393168.092553:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00100000:0.0:1787393168.095900:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393168.096096:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319558656 00000100:00100000:2.0:1787393168.096106:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319558656 00000100:00100000:2.0:1787393168.096162:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:2.0:1787393168.096187:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:10271:x1874217319558656:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1787393168.096541:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+16:10271:x1874217319558656:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 354us (650us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787393168.096549:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:3.0:1787393168.187081:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393168.187180:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319558784 00000100:00100000:1.0:1787393168.187190:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319558784 00000100:00100000:1.0:1787393168.187259:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:1.0:1787393168.187269:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+16:10277:x1874217319558784:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393168.187293:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393168.187322:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f16bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d69d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.187388:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f16c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.187401:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f16c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.187412:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f16c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393168.187470:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787393168.187486:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393168.187512:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f16c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.187539:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f16bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d69d expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.187556:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f16c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d69d expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.187564:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:1.0:1787393168.187568:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787393168.187571:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385a200, rc 0) 00000100:00100000:1.0:1787393168.187634:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+17:10277:x1874217319558784:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 365us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393168.187642:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:0.0:1787393168.192961:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393168.194084:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319559040 00000100:00100000:1.0:1787393168.194096:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319559040 00000100:00100000:1.0:1787393168.194161:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:1.0:1787393168.194172:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+17:10277:x1874217319559040:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393168.194193:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393168.194492:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f16c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d6a4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.194589:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f16d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.194603:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f16d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.194634:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f16d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393168.194711:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787393168.194925:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f16c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6a4 expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.195014:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f16d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6a4 expref: 19 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.195024:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54b00) 00010000:00010000:1.0:1787393168.195028:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393168.195031:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385b600, rc 0) 00000100:00100000:1.0:1787393168.195156:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:10277:x1874217319559040:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 985us (2203us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787393168.195165:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:3.0:1787393168.200184:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393168.200229:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393168.200515:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319559168 00000100:00100000:1.0:1787393168.200525:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319559168 00000100:00100000:1.0:1787393168.200584:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:1.0:1787393168.200596:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:2353:x1874217319559168:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393168.200611:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393168.200635:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f16d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6a4 expref: 19 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.200665:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54b00) 00010000:00010000:1.0:1787393168.200670:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393168.200731:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+18:2353:x1874217319559168:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 138us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393168.200740:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:2.0:1787393168.200928:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319559424 00000100:00100000:2.0:1787393168.200933:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319559424 00000100:00100000:2.0:1787393168.200976:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 44 00000100:00100000:2.0:1787393168.200984:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+18:10277:x1874217319559424:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1787393168.201001:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393168.201015:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f16de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d6ab expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.201114:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f16e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.201127:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f16e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.201137:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f16e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393168.201149:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787393168.201279:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f16de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ab expref: 21 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.201294:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f16e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ab expref: 20 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.202487:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54b00) 00010000:00010000:2.0:1787393168.202494:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787393168.202498:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4e00, rc 0) 00000100:00100000:2.0:1787393168.202654:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:10277:x1874217319559424:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1667us (2420us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787393168.202662:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 44 00000100:00100000:3.0:1787393168.211496:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393168.212023:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319559552 00000100:00100000:0.0:1787393168.212034:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319559552 00000100:00100000:0.0:1787393168.212153:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:0.0:1787393168.212164:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2356:x1874217319559552:12345-192.168.203.21@tcp:1:lfs.0 00010000:00010000:0.0:1787393168.212221:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a227d40/0x19a927d9c62f16f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.212241:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9af08ef/0x19a927d9c62f16a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d68f expref: 7 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.212266:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393168.212270:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787393168.212275:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a227d40/0x19a927d9c62f16f3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.212309:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9af08ef/0x19a927d9c62f16a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d68f expref: 7 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.212340:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9af08ef/0x19a927d9c62f16a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d68f expref: 7 pid: 6625 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393168.212355:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6624:1874217338465280:192.168.203.21@tcp:104: 00000100:00100000:0.0:1787393168.212453:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de701b71300 going to sleep for 11 seconds 00000100:00100000:0.0:1787393168.215813:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393168.215888:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393168.215996:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393168.216029:0:6628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319559936 00000100:00100000:0.0:1787393168.216037:0:6628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319559936 00002000:00100000:0.0:1787393168.216089:0:6628:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9de83ca21500 x1874217319559936/t0(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:139/0 lens 504/0 e 0 to 0 dl 1787393179 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787393168.216101:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de83ca21500 with x1874217319559936 ext(0->12) 00010000:00010000:0.0:1787393168.216110:0:6628:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e9af08ef/0x19a927d9c62f16a6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d68f expref: 8 pid: 6625 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.216127:0:6628:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e9af08ef/0x19a927d9c62f16a6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d68f expref: 8 pid: 6625 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787393168.216148:0:6628:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9de83ca21500 00000100:00100000:0.0:1787393168.216181:0:6628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:0.0:1787393168.216190:0:6628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2355:x1874217319559936:12345-192.168.203.21@tcp:4:lfs.0 00000100:00100000:0.0:1787393168.216506:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6624:1874217338465280:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787393168.216528:0:6624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a227d40/0x19a927d9c62f16f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393168.216743:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319559680 00000100:00100000:3.0:1787393168.216748:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319559680 00000100:00100000:3.0:1787393168.216784:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 281 00000100:00100000:3.0:1787393168.216798:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319559680:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393168.216883:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319559680:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 84us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393168.216890:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 281 00000100:00100000:1.0:1787393168.217404:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319559808 00000100:00100000:1.0:1787393168.217410:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319559808 00000100:00100000:1.0:1787393168.217452:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 123 00000100:00100000:1.0:1787393168.217460:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319559808:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393168.217499:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319559808:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 39us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393168.217505:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 123 00000100:00080000:3.0:1787393168.218011:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1787393168.253048:0:7527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00000100:00100000:0.0:1787393168.254403:0:6628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:2355:x1874217319559936:12345-192.168.203.21@tcp:4:lfs.0 Request processed in 38206us (38398us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787393168.254416:0:6628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00002000:00100000:0.0:1787393168.254428:0:6628:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9de83ca21500 x1874217319559936/t4294967299(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:139/0 lens 504/448 e 0 to 0 dl 1787393179 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787393168.254439:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de83ca21500 with x1874217319559936 ext(0->12) 00010000:00010000:0.0:1787393168.254449:0:6628:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e9af08ef/0x19a927d9c62f16a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d68f expref: 9 pid: 6625 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.254468:0:6628:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e9af08ef/0x19a927d9c62f16a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d68f expref: 9 pid: 6625 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787393168.254476:0:6628:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9de83ca21500 00000100:00100000:0.0:1787393168.258021:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393168.258205:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319560064 00000100:00100000:2.0:1787393168.258216:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319560064 00010000:00010000:2.0:1787393168.258258:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9af08ef/0x19a927d9c62f16a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d68f expref: 9 pid: 6625 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393168.258356:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:2.0:1787393168.258367:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:2354:x1874217319560064:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393168.258382:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787393168.258401:0:5807:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787393168.258404:0:5807:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787393168 00002000:00010000:2.0:1787393168.258406:0:5807:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787393168 00002000:00010000:2.0:1787393168.258408:0:5807:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787393168 00010000:00010000:2.0:1787393168.258414:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9af08ef/0x19a927d9c62f16a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d68f expref: 9 pid: 6625 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.258427:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9af08ef/0x19a927d9c62f16a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d68f expref: 9 pid: 6625 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.258450:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9af08ef/0x19a927d9c62f16a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d68f expref: 9 pid: 6625 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.258612:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787393168.258616:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787393168.258622:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a227d40/0x19a927d9c62f16f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.258632:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a227d40/0x19a927d9c62f16f3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.258684:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393168.258741:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2354:x1874217319560064:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 375us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393168.258748:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 36 00010000:00010000:0.0:1787393168.259822:0:6624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a227d40/0x19a927d9c62f16f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.259871:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a227d40/0x19a927d9c62f16f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.259903:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a227d40/0x19a927d9c62f16f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.259912:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a227d40/0x19a927d9c62f16f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.259921:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a227d40/0x19a927d9c62f16f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.259928:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761d600 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393168.259933:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a227d40/0x19a927d9c62f16f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.259953:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a227d40/0x19a927d9c62f16f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.259971:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a227d40/0x19a927d9c62f16f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.259979:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a227d40/0x19a927d9c62f16f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393168.260062:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2356:x1874217319559552:12345-192.168.203.21@tcp:1:lfs.0 Request processed in 47897us (48575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393168.260083:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:0.0:1787393168.263603:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393168.264251:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319560320 00000100:00100000:1.0:1787393168.264262:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319560320 00000100:00100000:1.0:1787393168.264318:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:1.0:1787393168.264328:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:10277:x1874217319560320:12345-192.168.203.21@tcp:35:lfs.0 00000004:00010000:1.0:1787393168.264389:0:5824:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f16e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ab expref: 20 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787393168.264673:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1787393168.264730:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1787393168.265554:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1787393168.265614:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f16fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.265631:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f168a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d681 expref: 24 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.265639:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f16fa lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.265682:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f168a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d681 expref: 24 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.265697:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f168a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d681 expref: 24 pid: 5820 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393168.265712:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810336300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5824:1874217338465408:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393168.265793:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb59480 going to sleep for 11 seconds 00000100:00100000:3.0:1787393168.269928:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393168.270122:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810336300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5824:1874217338465408:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393168.270145:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f16fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393168.270227:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319560448 00000100:00100000:2.0:1787393168.270235:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319560448 00010000:00010000:2.0:1787393168.270268:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f168a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d681 expref: 25 pid: 5820 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393168.270306:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:2.0:1787393168.270326:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+25:2355:x1874217319560448:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393168.270338:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393168.270345:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f168a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d681 expref: 25 pid: 5820 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.270357:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f168a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d681 expref: 25 pid: 5820 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.270396:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f168a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d681 expref: 25 pid: 5820 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.270410:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54b00) 00010000:00010000:2.0:1787393168.270414:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f16fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.270424:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f16fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.270431:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f16fa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.270451:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393168.270505:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+24:2355:x1874217319560448:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 189us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393168.270512:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 37 00010000:00010000:3.0:1787393168.271265:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f16fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393168.271277:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f16fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787393168.271412:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787393168.271610:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1787393168.271716:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5af800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5824:1874217338465536:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787393168.271803:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393168.271879:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de803ea43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393168.272084:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338465536 00000100:00100000:1.0:1787393168.272091:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338465536 00000100:00100000:1.0:1787393168.272154:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787393168.272163:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1874217338465536:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787393168.272246:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1874217338465536:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 84us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393168.272253:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787393168.272335:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5af800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5824:1874217338465536:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787393168.273033:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1787393168.273121:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5824:1874217338465664:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787393168.273164:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393168.273191:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de701b71900 going to sleep for 11 seconds 00000100:00100000:2.0:1787393168.273344:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338465664 00000100:00100000:2.0:1787393168.273350:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338465664 00000100:00100000:2.0:1787393168.273382:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787393168.273391:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1874217338465664:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787393168.273562:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5824:x1874217338465664:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 170us (395us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787393168.273569:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787393168.273740:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca23480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5824:1874217338465664:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787393168.273791:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1787393168.273828:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f16fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.273868:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f16fa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.273877:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f16fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.273884:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393168.273888:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f16fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.273896:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f16fa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.273927:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54b00) 00010000:00010000:0.0:1787393168.273930:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787393168.273934:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f16fa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393168.274132:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f16fa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787393168.274503:0:5824:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787393168.274717:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787393168.274727:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 317449887278ns, next at 318449885474ns, rc = 0 00000001:00080000:0.0:1787393168.274734:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1787393168.274767:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54b00) 00010000:00010000:0.0:1787393168.274770:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787393168.274778:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f16e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ab expref: 28 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787393168.274963:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787393168.275615:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+27:10277:x1874217319560320:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 11285us (12017us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787393168.275626:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00000020:00080000:0.0:1787393168.275631:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787393168.280297:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393168.280494:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319560576 00000100:00100000:1.0:1787393168.280505:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319560576 00000100:00100000:1.0:1787393168.280564:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:1.0:1787393168.280575:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+27:10277:x1874217319560576:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393168.280600:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393168.280623:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1701 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d6b2 expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.280704:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1701 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6b2 expref: 28 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.280720:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1701 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6b2 expref: 28 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.280739:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:1.0:1787393168.280742:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787393168.280746:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385ae00, rc 0) 00000100:00100000:1.0:1787393168.280808:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+28:10277:x1874217319560576:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 235us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393168.280815:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:3.0:1787393168.284950:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393168.285049:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319560832 00000100:00100000:2.0:1787393168.285060:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319560832 00000100:00100000:2.0:1787393168.285128:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:2.0:1787393168.285138:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818e6a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+28:10277:x1874217319560832:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1787393168.285407:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818e6a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+29:10277:x1874217319560832:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 269us (474us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787393168.285415:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:0.0:1787393168.390076:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393168.390215:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319561088 00000100:00100000:1.0:1787393168.390226:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319561088 00000100:00100000:1.0:1787393168.390307:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00100000:1.0:1787393168.390328:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+29:10287:x1874217319561088:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393168.390353:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393168.390373:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1708 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d6b9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393168.390495:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787393168.390614:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1708 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6b9 expref: 31 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.390627:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54c00) 00010000:00010000:1.0:1787393168.390630:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787393168.390647:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1708 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6b9 expref: 31 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.390661:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385b400, rc 0) 00000100:00100000:1.0:1787393168.390721:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+30:10287:x1874217319561088:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 396us (664us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1787393168.390728:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00100000:3.0:1787393168.397786:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393168.397889:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319561216 00000100:00100000:1.0:1787393168.397899:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319561216 00000100:00100000:1.0:1787393168.397960:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:1.0:1787393168.397969:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+30:10287:x1874217319561216:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:1.0:1787393168.398040:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1716 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398057:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1716 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398078:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1716 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398094:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f171d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398101:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f171d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398108:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f171d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398229:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1724 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398252:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398259:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787393168.398319:0:10433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398332:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1716 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398338:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1716 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398345:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1716 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398351:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385b400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393168.398355:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1716 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398362:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1716 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398373:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:1.0:1787393168.398376:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393168.398380:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1716 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398386:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1716 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398408:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f171d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398413:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f171d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398419:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f171d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398424:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385b800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393168.398427:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f171d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398433:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f171d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398441:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de81aa54600) 00010000:00010000:1.0:1787393168.398443:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393168.398446:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f171d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398452:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f171d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398465:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398471:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1724 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398477:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1724 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398488:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393168.398492:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1724 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398497:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1724 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398505:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:1.0:1787393168.398508:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393168.398511:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1724 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.398516:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1724 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393168.398591:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+30:10287:x1874217319561216:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 622us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393168.398601:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:3.0:1787393168.403387:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393168.403598:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319561472 00000100:00100000:2.0:1787393168.403608:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319561472 00000100:00100000:2.0:1787393168.403669:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:2.0:1787393168.403679:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+30:10287:x1874217319561472:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1787393168.403988:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+31:10287:x1874217319561472:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 309us (610us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787393168.403996:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:0.0:1787393168.459755:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393168.459887:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319561728 00000100:00100000:1.0:1787393168.459897:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319561728 00000100:00100000:1.0:1787393168.459966:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:1.0:1787393168.459976:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+31:10290:x1874217319561728:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393168.460003:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393168.460024:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f172b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d6c0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460121:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1732 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460146:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1732 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460159:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1732 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460175:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1739 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460182:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460189:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460345:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f1740 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460354:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f1740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460361:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f1740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393168.460379:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787393168.460470:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1732 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460479:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1732 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460486:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1732 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460498:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385b800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393168.460503:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1732 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460511:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1732 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460524:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:1.0:1787393168.460527:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393168.460531:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1732 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460537:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1732 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460551:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460557:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1739 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460564:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1739 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460569:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385b400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393168.460572:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1739 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460578:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1739 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460595:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de81aa54600) 00010000:00010000:1.0:1787393168.460597:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393168.460600:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1739 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460606:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1739 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460648:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f172b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6c0 expref: 34 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460661:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f1740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6c0 expref: 33 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.460668:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:1.0:1787393168.460670:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393168.460672:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385be00, rc 0) 00000100:00100000:1.0:1787393168.460735:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+33:10290:x1874217319561728:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 760us (989us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1787393168.460743:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:3.0:1787393168.467295:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393168.467524:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319561856 00000100:00100000:1.0:1787393168.467534:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319561856 00000100:00100000:1.0:1787393168.467598:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:1.0:1787393168.467609:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+33:10290:x1874217319561856:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:1.0:1787393168.467682:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f174e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.467700:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f174e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.467718:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f174e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.467745:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f174e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.467752:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f174e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.467759:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f174e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.467766:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393168.467770:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f174e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.467778:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f174e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.467790:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:1.0:1787393168.467794:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787393168.467798:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f174e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.467804:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f174e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393168.467926:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+33:10290:x1874217319561856:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 318us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393168.467934:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:3.0:1787393168.470935:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393168.471015:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319562112 00000100:00100000:2.0:1787393168.471025:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319562112 00000100:00100000:2.0:1787393168.471093:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:2.0:1787393168.471106:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+33:10290:x1874217319562112:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1787393168.471587:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+34:10290:x1874217319562112:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 482us (659us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787393168.471597:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:0.0:1787393168.744367:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787393168.744428:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de80ba19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338465792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787393168.744496:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393168.745039:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338465792 00000100:00100000:3.0:1787393168.745049:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338465792 00000100:00100000:3.0:1787393168.745132:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787393168.745142:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338465792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787393168.745201:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787393168.745270:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338465792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393168.745278:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787393168.745455:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de80ba19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338465792:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787393168.745576:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787393168.799486:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393168.799588:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319562368 00000100:00100000:1.0:1787393168.799599:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319562368 00000100:00100000:1.0:1787393168.799733:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:1.0:1787393168.799745:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+34:10321:x1874217319562368:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:1.0:1787393168.799768:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393168.799790:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1755 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d6c7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.799915:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f175c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.799929:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f175c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.799941:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f175c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393168.799954:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787393168.800102:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1755 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6c7 expref: 37 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.800119:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f175c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6c7 expref: 36 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.800128:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:1.0:1787393168.800130:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393168.800133:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385b400, rc 0) 00000100:00100000:1.0:1787393168.800195:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+36:10321:x1874217319562368:12345-192.168.203.21@tcp:101:cat.0 Request processed in 453us (719us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787393168.800228:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:3.0:1787393168.807041:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393168.808319:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319562624 00000100:00100000:0.0:1787393168.808344:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319562624 00000100:00100000:0.0:1787393168.808406:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:0.0:1787393168.808415:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+36:10321:x1874217319562624:12345-192.168.203.21@tcp:35:cat.0 00000100:00100000:0.0:1787393168.808944:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+37:10321:x1874217319562624:12345-192.168.203.21@tcp:35:cat.0 Request processed in 528us (1910us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787393168.808953:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:3.0:1787393168.815128:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393168.815205:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319562752 00000100:00100000:2.0:1787393168.815215:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319562752 00000100:00100000:2.0:1787393168.815328:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:2.0:1787393168.815338:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de826cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+37:2355:x1874217319562752:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393168.815353:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393168.815376:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f175c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6c7 expref: 37 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.815405:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:2.0:1787393168.815409:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393168.815471:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de826cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+36:2355:x1874217319562752:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 134us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393168.815478:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 3 00010000:00010000:3.0:1787393168.875996:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393168.884208:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393168.884404:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319563008 00000100:00100000:1.0:1787393168.884414:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319563008 00000100:00100000:1.0:1787393168.884473:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:1.0:1787393168.884483:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+36:10327:x1874217319563008:12345-192.168.203.21@tcp:101:dd.0 00010000:00010000:1.0:1787393168.884507:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393168.884510:0:10433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787393168.884534:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f16c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d69d expref: 36 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.884553:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:1.0:1787393168.884557:0:10433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787393168.884569:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f176a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d6ce expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.884924:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1771 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.884940:0:10433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f1740 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6c0 expref: 36 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.884948:0:10433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1771 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.884979:0:10433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f1740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6c0 expref: 36 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.885121:0:10433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f1740 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6c0 expref: 36 pid: 5822 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393168.885149:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810336300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338465920:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393168.885594:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb59300 going to sleep for 11 seconds 00000100:00100000:1.0:1787393168.889592:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810336300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338465920:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393168.889632:0:10433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1771 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393168.891115:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393168.892815:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319563136 00000100:00100000:1.0:1787393168.892828:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319563136 00010000:00010000:1.0:1787393168.892899:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f1740 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6c0 expref: 37 pid: 5822 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393168.892943:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00100000:1.0:1787393168.892953:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+37:2355:x1874217319563136:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393168.892966:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393168.892972:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f1740 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6c0 expref: 37 pid: 5822 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.892985:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f1740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6c0 expref: 37 pid: 5822 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.893015:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f1740 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6c0 expref: 37 pid: 5822 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.893030:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:1.0:1787393168.893035:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1771 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.893055:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1771 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.893071:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1771 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393168.893102:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393168.893161:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+36:2355:x1874217319563136:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 209us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393168.893168:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 38 00010000:00010000:2.0:1787393168.893285:0:10433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1771 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.893294:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1771 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393168.893312:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787393168.893455:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f176a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ce expref: 37 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.893469:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1771 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ce expref: 36 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.893476:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:2.0:1787393168.893478:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787393168.893481:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385b800, rc 0) 00000100:00100000:2.0:1787393168.893504:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+36:10327:x1874217319563008:12345-192.168.203.21@tcp:101:dd.0 Request processed in 9023us (9317us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787393168.893510:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:0.0:1787393168.902014:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393168.902087:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319563392 00000100:00100000:2.0:1787393168.902098:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319563392 00000100:00100000:2.0:1787393168.902150:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00100000:2.0:1787393168.902171:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+36:10327:x1874217319563392:12345-192.168.203.21@tcp:36:dd.0 00010000:00010000:2.0:1787393168.902414:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f177f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.902431:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f177f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.902443:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f177f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787393168.902484:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787393168.902503:0:5821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007bd09caf reply state 000000006c73eae7 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f177f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393168.902512:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787393168.902594:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+39:10327:x1874217319563392:12345-192.168.203.21@tcp:36:dd.0 Request processed in 423us (587us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787393168.902602:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 52 00000020:00080000:2.0:1787393168.902607:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787393168.910017:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f177f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.910034:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f177f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.910041:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f177f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.910047:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393168.910052:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f177f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.910090:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f177f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.910107:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:2.0:1787393168.910110:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393168.910115:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f177f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393168.910120:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f177f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393169.194397:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393169.194503:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319563520 00000100:00100000:2.0:1787393169.194513:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319563520 00000100:00100000:2.0:1787393169.194590:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 53 00000100:00100000:2.0:1787393169.194601:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+38:10341:x1874217319563520:12345-192.168.203.21@tcp:101:stat.0 00010000:00010000:2.0:1787393169.194624:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393169.194644:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1786 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d6d5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.194707:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f178d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.194720:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f178d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.194732:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f178d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787393169.194959:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787393169.195016:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1794 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.195042:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.195050:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.195161:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f179b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.195173:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1771 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ce expref: 39 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.195181:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f179b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.195225:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1771 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ce expref: 39 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.195239:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1771 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ce expref: 39 pid: 10433 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393169.195254:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c685180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1874217338466048:192.168.203.21@tcp:104: 00000100:00100000:2.0:1787393169.195367:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de808313c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787393169.206997:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393169.207189:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319563776 00000100:00100000:1.0:1787393169.207199:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319563776 00000100:00100000:1.0:1787393169.207260:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:1.0:1787393169.207270:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+40:5566:x1874217319563776:12345-192.168.203.21@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787393169.207606:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+41:5566:x1874217319563776:12345-192.168.203.21@tcp:35:ldlm_bl.0 Request processed in 336us (616us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787393169.207614:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:2.0:1787393169.208129:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c685180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1874217338466048:192.168.203.21@tcp:104: 00010000:00010000:2.0:1787393169.208154:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f179b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393169.220275:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393169.220358:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319563904 00000100:00100000:2.0:1787393169.220379:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319563904 00010000:00010000:2.0:1787393169.220414:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1771 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ce expref: 41 pid: 10433 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393169.220462:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:2.0:1787393169.220472:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+41:2356:x1874217319563904:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393169.220485:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393169.220492:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1771 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ce expref: 41 pid: 10433 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.220505:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1771 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ce expref: 41 pid: 10433 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.220531:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1771 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ce expref: 41 pid: 10433 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.220547:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:2.0:1787393169.220552:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f179b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.220561:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f179b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.220568:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f179b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.220599:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393169.220650:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+40:2356:x1874217319563904:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 179us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393169.220667:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 39 00010000:00010000:3.0:1787393169.220726:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f179b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.220736:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f179b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393169.220787:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787393169.220792:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787393169.220824:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f179b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.220871:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f179b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.220882:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f178d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.220889:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f178d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.220895:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f178d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.220912:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393169.220916:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f178d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.220924:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f178d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.220934:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:3.0:1787393169.220936:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393169.220940:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f178d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.220946:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f178d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.220957:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.220963:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1794 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.220969:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.220974:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393169.220977:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.220982:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1794 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.220998:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de818bd8500) 00010000:00010000:3.0:1787393169.221000:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393169.221003:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1794 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.221009:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1794 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.221042:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1786 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6d5 expref: 40 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.221055:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f179b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6d5 expref: 39 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.221073:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:3.0:1787393169.221076:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787393169.221079:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4400, rc 0) 00000100:00100000:3.0:1787393169.221113:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+39:10341:x1874217319563520:12345-192.168.203.21@tcp:101:stat.0 Request processed in 26509us (26722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393169.221121:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 53 00000100:00100000:2.0:1787393169.256264:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338466176:0@lo:400:kworker.0 00000100:00100000:3.0:1787393169.256269:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338466560:0@lo:400:kworker.0 00000100:00100000:1.0:1787393169.256318:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3325:1874217338466432:0@lo:400:kworker.0 00000100:00100000:0.0:1787393169.256336:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338466304:0@lo:400:kworker.0 00000100:00100000:2.0:1787393169.259130:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393169.259192:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338466688:0@lo:400:kworker.0 00000100:00100000:0.0:1787393169.259274:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393169.259299:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338466816:0@lo:400:kworker.0 00000100:00100000:0.0:1787393169.259324:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393169.259388:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393169.259395:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338466176 00000100:00100000:0.0:1787393169.259404:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338466176 00000100:00100000:1.0:1787393169.259465:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338466304 00000100:00100000:1.0:1787393169.259470:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338466304 00000100:00100000:1.0:1787393169.259500:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338466432 00000100:00100000:1.0:1787393169.259504:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338466432 00000100:00100000:1.0:1787393169.259534:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787393169.259543:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338466304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393169.259599:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338466304:12345-0@lo:400:kworker.0 Request processed in 57us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393169.259620:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787393169.259637:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787393169.259643:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1874217338466432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393169.259676:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1874217338466432:12345-0@lo:400:kworker.0 Request processed in 33us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393169.259682:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787393169.260026:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393169.260121:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338466816 00000100:00100000:3.0:1787393169.260125:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338466816 00000100:00100000:1.0:1787393169.260189:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3325:1874217338466432:0@lo:400:kworker.0 00000100:00080000:1.0:1787393169.260239:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393169.260266:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338466304:0@lo:400:kworker.0 00000100:00100000:1.0:1787393169.260289:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338466560 00000100:00100000:1.0:1787393169.260293:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338466560 00000100:00100000:1.0:1787393169.260316:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787393169.260323:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3324:x1874217338466816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393169.260454:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3324:x1874217338466816:12345-0@lo:400:kworker.0 Request processed in 130us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393169.260461:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787393169.260475:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787393169.260481:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338466560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393169.260512:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338466560:12345-0@lo:400:kworker.0 Request processed in 32us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393169.260519:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787393169.260549:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338466816:0@lo:400:kworker.0 00000100:00100000:2.0:1787393169.261017:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393169.261085:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338466560:0@lo:400:kworker.0 00000100:00100000:0.0:1787393169.261182:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787393169.261195:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3327:x1874217338466176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393169.261241:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3327:x1874217338466176:12345-0@lo:400:kworker.0 Request processed in 50us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393169.261249:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787393169.261290:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338466176:0@lo:400:kworker.0 00000100:00100000:1.0:1787393169.261878:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338466688 00000100:00100000:1.0:1787393169.261885:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338466688 00000100:00100000:1.0:1787393169.261949:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787393169.261957:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874217338466688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393169.262002:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874217338466688:12345-0@lo:400:kworker.0 Request processed in 47us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393169.262009:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1787393169.262158:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393169.262184:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338466688:0@lo:400:kworker.0 00000100:00100000:3.0:1787393169.328251:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393169.328361:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319564160 00000100:00100000:1.0:1787393169.328372:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319564160 00000100:00100000:1.0:1787393169.328427:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 54 00000100:00100000:1.0:1787393169.328445:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+39:10347:x1874217319564160:12345-192.168.203.21@tcp:36:truncate.0 00010000:00010000:1.0:1787393169.328504:0:10433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393169.328527:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f179b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6d5 expref: 39 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.328545:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:1.0:1787393169.328549:0:10433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787393169.328728:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f17a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.328751:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f17a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.328760:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f17a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787393169.328804:0:10433:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1787393169.328824:0:10433:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b4a78415 reply state 0000000044471f9a transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f17a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393169.328833:0:10433:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787393169.328981:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+41:10347:x1874217319564160:12345-192.168.203.21@tcp:36:truncate.0 Request processed in 544us (738us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787393169.328988:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 54 00000020:00080000:1.0:1787393169.328992:0:10433:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787393169.336787:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f17a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.336806:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f17a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.336814:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f17a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.336829:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385be00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393169.336835:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f17a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.336874:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f17a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.336892:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:2.0:1787393169.336895:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393169.336899:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f17a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.336905:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f17a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393169.524597:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393169.524947:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319564288 00000100:00100000:1.0:1787393169.524958:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319564288 00000100:00100000:1.0:1787393169.525021:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00100000:1.0:1787393169.525031:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+40:10361:x1874217319564288:12345-192.168.203.21@tcp:101:stat.0 00010000:00010000:1.0:1787393169.525054:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393169.525089:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f17a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d6dc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525154:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f17b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525167:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f17b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525178:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f17b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525190:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f17b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525196:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f17b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525202:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f17b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525296:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f17be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525317:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f17be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525325:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f17be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393169.525357:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787393169.525362:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393169.525383:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f17be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525393:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f17be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525402:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f17b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525408:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f17b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525414:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f17b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525419:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385b000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393169.525423:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f17b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525429:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f17b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525451:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:1.0:1787393169.525468:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393169.525474:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f17b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525480:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f17b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525495:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f17b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525501:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f17b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525507:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f17b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525511:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385b600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393169.525514:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f17b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525520:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f17b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525527:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de81aa54600) 00010000:00010000:1.0:1787393169.525530:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393169.525532:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f17b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525537:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f17b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525567:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f17a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6dc expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525591:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f17be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6dc expref: 41 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.525598:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:1.0:1787393169.525601:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393169.525603:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385ba00, rc 0) 00000100:00100000:1.0:1787393169.525670:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+41:10361:x1874217319564288:12345-192.168.203.21@tcp:101:stat.0 Request processed in 640us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393169.525677:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00100000:0.0:1787393169.656168:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393169.656543:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319564544 00000100:00100000:1.0:1787393169.656554:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319564544 00000100:00100000:1.0:1787393169.656618:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 56 00000100:00100000:1.0:1787393169.656628:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+41:10371:x1874217319564544:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393169.656647:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393169.656666:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f17c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d6e3 expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393169.656792:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787393169.656950:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f17c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6e3 expref: 43 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.656965:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54c00) 00010000:00010000:1.0:1787393169.656968:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787393169.656973:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f17c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6e3 expref: 43 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.657005:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385a200, rc 0) 00000100:00100000:1.0:1787393169.657078:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+42:10371:x1874217319564544:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 451us (919us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1787393169.657087:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 56 00000100:00100000:3.0:1787393169.662894:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393169.662946:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319564800 00000100:00100000:1.0:1787393169.662958:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319564800 00000100:00100000:1.0:1787393169.663013:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:1.0:1787393169.663024:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+42:10371:x1874217319564800:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1787393169.663292:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+43:10371:x1874217319564800:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 271us (408us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787393169.663301:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 14 00000004:00080000:0.0:1787393169.768079:0:7897:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 318943236321ns, next at 319943233926ns, rc = 0 00000100:00100000:3.0:1787393169.768088:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787393169.768110:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338466944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787393169.768180:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393169.768337:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338466944 00000100:00100000:0.0:1787393169.768346:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338466944 00000100:00100000:0.0:1787393169.768397:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787393169.768407:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3324:x1874217338466944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787393169.768428:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393169.768484:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3324:x1874217338466944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393169.768500:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787393169.768602:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338466944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787393169.804130:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393169.805037:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319565056 00000100:00100000:3.0:1787393169.805047:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319565056 00000100:00100000:3.0:1787393169.805141:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:3.0:1787393169.805151:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+43:10377:x1874217319565056:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1787393169.805172:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393169.805190:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f17d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d6ea expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.805273:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f17da lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.805287:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f17be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6dc expref: 44 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.805296:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f17da lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.805325:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f17be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6dc expref: 44 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.805336:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f17be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6dc expref: 44 pid: 5822 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393169.805348:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de80ba19180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1874217338467072:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393169.805454:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de803ea46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787393169.816663:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393169.816700:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319565184 00000100:00100000:0.0:1787393169.816709:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319565184 00010000:00010000:0.0:1787393169.816748:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f17be lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6dc expref: 45 pid: 5822 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393169.816779:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 40 00000100:00100000:0.0:1787393169.816788:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+45:2356:x1874217319565184:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787393169.816801:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393169.816806:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f17be lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6dc expref: 45 pid: 5822 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393169.816819:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f17be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6dc expref: 45 pid: 5822 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393169.816855:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:0.0:1787393169.816861:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f17da lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393169.816883:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f17da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393169.816891:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f17da lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393169.816909:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393169.817090:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+45:2356:x1874217319565184:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 301us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393169.817098:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 40 00010000:00010000:0.0:1787393169.817146:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f17be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6dc expref: 44 pid: 5822 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393169.817164:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de80ba19180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1874217338467072:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787393169.817181:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f17da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393169.817900:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f17da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393169.817910:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f17da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393169.818081:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787393169.818764:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f17d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ea expref: 45 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393169.818787:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f17da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ea expref: 44 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393169.818816:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:0.0:1787393169.818819:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787393169.818822:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530200, rc 0) 00000100:00100000:0.0:1787393169.818898:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+44:10377:x1874217319565056:12345-192.168.203.21@tcp:101:bash.0 Request processed in 13747us (14775us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1787393169.818907:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:0.0:1787393169.828153:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393169.828441:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319565440 00000100:00100000:1.0:1787393169.828451:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319565440 00000100:00100000:1.0:1787393169.828511:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00100000:1.0:1787393169.828519:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+44:10377:x1874217319565440:12345-192.168.203.21@tcp:36:bash.0 00010000:00010000:0.0:1787393169.839620:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f17e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393169.839644:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f17e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393169.839658:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f17e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787393169.839759:0:10433:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1787393169.839806:0:10433:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e69ef7a reply state 000000001b1758ba transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f17e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393169.839816:0:10433:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787393169.839965:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+47:10377:x1874217319565440:12345-192.168.203.21@tcp:36:bash.0 Request processed in 11441us (11816us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787393169.839973:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 58 00000020:00080000:0.0:1787393169.839979:0:10433:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787393169.856168:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f17e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.856186:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f17e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.856194:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f17e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.856199:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761c800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393169.856203:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f17e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.856211:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f17e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.856227:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:2.0:1787393169.856230:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393169.856234:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f17e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.856240:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f17e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393169.867946:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393169.869066:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319565568 00000100:00100000:3.0:1787393169.869080:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319565568 00000100:00100000:3.0:1787393169.869162:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 59 00000100:00100000:3.0:1787393169.869173:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+46:10377:x1874217319565568:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1787393169.869206:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393169.869513:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f17ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d6f1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.869602:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f17f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.869619:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f17da lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ea expref: 47 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.869629:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f17f6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.869661:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f17da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ea expref: 47 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.869675:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f17da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ea expref: 47 pid: 5822 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393169.869688:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de80ba1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1874217338467200:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393169.869775:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de803ea46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787393169.877703:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de80ba1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1874217338467200:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393169.877733:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f17f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393169.879741:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393169.880314:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319565696 00000100:00100000:1.0:1787393169.880325:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319565696 00010000:00010000:1.0:1787393169.880361:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f17da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ea expref: 48 pid: 5822 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393169.880400:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00100000:1.0:1787393169.880409:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+48:2355:x1874217319565696:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393169.880422:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393169.880438:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f17da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ea expref: 48 pid: 5822 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.880452:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f17da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ea expref: 48 pid: 5822 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.880473:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f17da lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ea expref: 48 pid: 5822 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.880489:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:1.0:1787393169.880494:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f17f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.880502:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f17f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.880509:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f17f6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.880791:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393169.880872:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+47:2355:x1874217319565696:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 463us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393169.880881:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 41 00010000:00010000:2.0:1787393169.883449:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f17f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.883465:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f17f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393169.883535:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787393169.883540:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787393169.883562:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f17f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.883602:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f17ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6f1 expref: 47 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.883620:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f17f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6f1 expref: 46 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393169.883629:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:2.0:1787393169.883632:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787393169.883636:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531a00, rc 0) 00000004:00080000:3.0:1787393169.884017:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1787393169.884206:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967332 is committed 00000004:00080000:3.0:1787393169.884212:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787393169.884221:0:5842:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9de701b71180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787393169.884225:0:5842:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9de818bc9000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9de701b71d80 00000100:00100000:1.0:1787393169.884466:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338467328:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787393169.884536:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393169.884586:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338467328 00000100:00100000:1.0:1787393169.884593:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338467328 00000100:00100000:1.0:1787393169.884634:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787393169.884642:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3326:x1874217338467328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787393169.884675:0:6625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1787393169.884705:0:6625:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a897490, atime: 0x6a897490, ctime: 0x6a897490, blocks: 0x1 00010000:00010000:1.0:1787393169.884718:0:6625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000556bbe0c/0x19a927d9c62f17fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.884747:0:6625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=319s v=(0 0) 00010000:00010000:1.0:1787393169.884753:0:6625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393169.884759:0:6625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000556bbe0c/0x19a927d9c62f17fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.884774:0:6625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000556bbe0c/0x19a927d9c62f17fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.884782:0:6625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000556bbe0c/0x19a927d9c62f17fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.884789:0:6625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000556bbe0c/0x19a927d9c62f17fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787393169.884798:0:5842:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9de818bc9400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9de82d22f000 00000001:00080000:3.0:1787393169.884815:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967340 is committed 00000020:00080000:3.0:1787393169.884898:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00010000:00010000:1.0:1787393169.885311:0:6625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787393169.885458:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:10377:x1874217319565568:12345-192.168.203.21@tcp:101:bash.0 Request processed in 16284us (17518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393169.885466:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 59 00010000:00010000:0.0:1787393169.885563:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393169.885570:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000556bbe0c/0x19a927d9c62f17fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393169.885585:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385b600 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393169.885590:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000556bbe0c/0x19a927d9c62f17fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393169.885599:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000556bbe0c/0x19a927d9c62f17fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393169.885615:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000556bbe0c/0x19a927d9c62f17fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393169.885622:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000556bbe0c/0x19a927d9c62f17fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393169.885639:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393169.885641:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393169.885642:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393169.885742:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3326:x1874217338467328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1099us (1204us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787393169.885750:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1787393169.885795:0:3326:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9de83c63e300/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787393169.885801:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338467328:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1787393169.886362:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787393169.890433:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393169.890533:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319565952 00000100:00100000:3.0:1787393169.890542:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319565952 00000100:00100000:3.0:1787393169.890600:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:3.0:1787393169.890609:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818e68c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:10377:x1874217319565952:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:3.0:1787393169.891000:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818e68c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:10377:x1874217319565952:12345-192.168.203.21@tcp:35:bash.0 Request processed in 391us (575us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1787393169.891008:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00010000:00010000:3.0:1787393169.898065:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393169.974197:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393169.975211:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319566208 00000100:00100000:3.0:1787393169.975224:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319566208 00000100:00100000:3.0:1787393169.975278:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:3.0:1787393169.975289:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:10387:x1874217319566208:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1787393169.975519:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393169.975541:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1804 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d6f8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393169.975905:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787393169.976086:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1804 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6f8 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.976101:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54c00) 00010000:00010000:3.0:1787393169.976105:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787393169.976110:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1804 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6f8 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393169.976124:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530400, rc 0) 00000100:00100000:3.0:1787393169.976189:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+16:10387:x1874217319566208:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 901us (2001us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1787393169.976198:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:3.0:1787393169.981159:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393169.982002:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319566336 00000100:00100000:1.0:1787393169.982124:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319566336 00000100:00100000:1.0:1787393169.982401:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:1.0:1787393169.982412:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+16:10387:x1874217319566336:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:1.0:1787393169.982485:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1812 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.982501:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1812 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.982513:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1812 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.982526:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1819 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.982532:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.982537:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.982887:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1820 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.982897:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.982904:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787393169.982955:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.982976:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1812 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.982982:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1812 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.982989:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1812 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.982995:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385b000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393169.982999:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1812 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.983006:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1812 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.983017:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:1.0:1787393169.983020:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393169.983024:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1812 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.983030:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1812 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.983042:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.983047:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1819 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.983053:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1819 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.983077:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393169.983080:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1819 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.983086:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1819 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.983094:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de81aa54600) 00010000:00010000:1.0:1787393169.983097:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393169.983099:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1819 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.983105:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1819 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.983119:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.983125:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1820 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.983131:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1820 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.983136:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385aa00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393169.983138:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1820 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.983144:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1820 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.983161:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:1.0:1787393169.983163:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393169.983166:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1820 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393169.983172:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1820 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393169.983252:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+16:10387:x1874217319566336:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 840us (2101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393169.983260:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:0.0:1787393169.986940:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393169.987134:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319566592 00000100:00100000:1.0:1787393169.987145:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319566592 00000100:00100000:1.0:1787393169.987243:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:1.0:1787393169.987254:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+16:10387:x1874217319566592:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1787393169.987699:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+17:10387:x1874217319566592:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 446us (767us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787393169.987708:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:0.0:1787393170.029037:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393170.029142:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319566848 00000100:00100000:2.0:1787393170.029153:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319566848 00000100:00100000:2.0:1787393170.029265:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00100000:2.0:1787393170.029276:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+17:10390:x1874217319566848:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1787393170.029299:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393170.029384:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1827 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d6ff expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.029460:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f182e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.029491:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f182e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.029503:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f182e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.029521:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1835 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.029528:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.029534:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.029936:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f183c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.029945:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f183c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.029953:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f183c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393170.029964:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787393170.030074:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f182e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.030082:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f182e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.030089:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f182e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.030103:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393170.030107:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f182e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.030116:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f182e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.030128:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:2.0:1787393170.030131:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393170.030135:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f182e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.030141:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f182e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.030154:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.030159:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1835 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.030166:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.030171:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393170.030174:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.030179:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1835 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.030606:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de818bd8100) 00010000:00010000:2.0:1787393170.030609:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393170.030613:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1835 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.030619:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1835 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.030670:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1827 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ff expref: 20 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.030683:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f183c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ff expref: 19 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.030690:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:2.0:1787393170.030693:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787393170.030696:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5200, rc 0) 00000100:00100000:2.0:1787393170.030805:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:10390:x1874217319566848:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1530us (1778us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787393170.030813:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00100000:3.0:1787393170.034110:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393170.034248:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319566976 00000100:00100000:2.0:1787393170.034258:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319566976 00000100:00100000:2.0:1787393170.034318:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:2.0:1787393170.034329:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:10390:x1874217319566976:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:2.0:1787393170.034403:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f184a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.034420:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f184a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.034447:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f184a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.034475:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f184a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.034481:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f184a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.034488:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f184a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.034494:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393170.034499:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f184a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.034507:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f184a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.034520:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:2.0:1787393170.034524:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787393170.034528:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f184a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.034535:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f184a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393170.034614:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:10390:x1874217319566976:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 286us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393170.034623:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:0.0:1787393170.037581:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393170.039114:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393170.039197:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319567360 00000100:00100000:0.0:1787393170.039206:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319567360 00000100:00100000:0.0:1787393170.039263:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:0.0:1787393170.039273:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:2356:x1874217319567360:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787393170.039303:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393170.039337:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f183c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6ff expref: 19 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.039355:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:0.0:1787393170.039360:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393170.039413:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+18:2356:x1874217319567360:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 142us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393170.039421:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:1.0:1787393170.040877:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319567232 00000100:00100000:1.0:1787393170.040894:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319567232 00000100:00100000:1.0:1787393170.040957:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:1.0:1787393170.040966:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+18:10390:x1874217319567232:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1787393170.041424:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:10390:x1874217319567232:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 457us (3848us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787393170.041433:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:3.0:1787393170.190936:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393170.191047:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319567616 00000100:00100000:0.0:1787393170.191068:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319567616 00000100:00100000:0.0:1787393170.191134:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:0.0:1787393170.191144:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:10408:x1874217319567616:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:0.0:1787393170.191167:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393170.191197:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1851 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d706 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.191288:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1858 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.191302:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1858 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.191314:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1858 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393170.191325:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787393170.191440:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1851 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d706 expref: 22 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.191470:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1858 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d706 expref: 21 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.191479:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:0.0:1787393170.191481:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787393170.191485:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761ca00, rc 0) 00000100:00100000:0.0:1787393170.191543:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10408:x1874217319567616:12345-192.168.203.21@tcp:101:cat.0 Request processed in 400us (616us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787393170.191550:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:0.0:1787393170.238876:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393170.238969:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319567744 00000100:00100000:2.0:1787393170.238992:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319567744 00000100:00100000:2.0:1787393170.239050:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:2.0:1787393170.239069:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10409:x1874217319567744:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1787393170.239091:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393170.239110:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1866 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d70d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.239174:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f186d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.239187:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f186d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.239201:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f186d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393170.239410:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787393170.239414:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787393170.239491:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f186d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.239530:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1866 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d70d expref: 23 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.239546:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f186d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d70d expref: 22 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.239555:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:2.0:1787393170.239558:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787393170.239562:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5600, rc 0) 00000100:00100000:2.0:1787393170.239628:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+22:10409:x1874217319567744:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 561us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393170.239635:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:3.0:1787393170.253319:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393170.255223:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319568128 00000100:00100000:2.0:1787393170.255238:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319568128 00000100:00100000:2.0:1787393170.255306:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:2.0:1787393170.255317:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+22:10409:x1874217319568128:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1787393170.255670:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:10409:x1874217319568128:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 354us (2364us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787393170.255678:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:3.0:1787393170.258644:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393170.263225:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319568256 00000100:00100000:0.0:1787393170.263239:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319568256 00000100:00100000:0.0:1787393170.263373:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:0.0:1787393170.263384:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:10409:x1874217319568256:12345-192.168.203.21@tcp:103:lfs.0 00010000:00010000:0.0:1787393170.263399:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787393170.263436:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f17f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6f1 expref: 23 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.263461:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1858 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d706 expref: 22 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.263474:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1701 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d6b2 expref: 21 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.263496:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de81aa54e00) 00010000:00010000:0.0:1787393170.263547:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393170.263609:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:10409:x1874217319568256:12345-192.168.203.21@tcp:103:lfs.0 Request processed in 227us (4975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393170.263618:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:0.0:1787393170.266112:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393170.266196:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319568384 00000100:00100000:2.0:1787393170.266205:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319568384 00000100:00100000:2.0:1787393170.266294:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 66 00000100:00100000:2.0:1787393170.266303:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:10409:x1874217319568384:12345-192.168.203.21@tcp:58:lfs.0 00010000:00010000:2.0:1787393170.266422:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1874 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.266437:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1874 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.266448:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1874 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787393170.267150:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787393170.267368:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787393170.267432:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787393170.267545:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:10409:x1874217319568384:12345-192.168.203.21@tcp:58:lfs.0 Request processed in 1241us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393170.267555:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 66 00000100:00100000:3.0:1787393170.302998:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393170.303103:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319568512 00000100:00100000:2.0:1787393170.303113:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319568512 00000100:00100000:2.0:1787393170.303171:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 67 00000100:00100000:2.0:1787393170.303182:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:10411:x1874217319568512:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1787393170.303211:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393170.303230:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f187b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d714 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303304:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1882 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303316:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1882 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303327:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1882 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303339:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1889 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303346:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303351:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303637:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1890 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303646:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303666:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393170.303701:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787393170.303705:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787393170.303720:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303730:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303738:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1882 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303744:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1882 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303749:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1882 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303755:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393170.303758:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1882 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303765:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1882 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303776:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:2.0:1787393170.303778:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393170.303782:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1882 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303797:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1882 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303808:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303815:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1889 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303819:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1889 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303825:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393170.303828:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1889 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303833:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1889 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303897:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de818bd8000) 00010000:00010000:2.0:1787393170.303900:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393170.303903:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1889 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303909:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1889 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303937:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f187b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d714 expref: 22 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303949:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1890 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d714 expref: 21 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.303962:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8100) 00010000:00010000:2.0:1787393170.303965:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787393170.303967:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4400, rc 0) 00000100:00100000:2.0:1787393170.304017:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10411:x1874217319568512:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 836us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393170.304025:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 67 00000040:00080000:0.0:1787393170.600108:0:11566:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787393170.600119:0:11566:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787393170.600190:0:11566:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787393170.600197:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787393170.600339:0:11566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834daf100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11566:1874217338467456:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787393170.600637:0:11566:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de82d0f53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787393170.610788:0:11566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834daf100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11566:1874217338467456:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787393170.623042:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393170.623107:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319568640 00000100:00100000:0.0:1787393170.623116:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319568640 00000100:00100000:0.0:1787393170.623167:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:0.0:1787393170.623183:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10422:x1874217319568640:12345-192.168.203.21@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787393170.623280:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10422:x1874217319568640:12345-192.168.203.21@tcp:900:lhsmtool_posix.0 Request processed in 105us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393170.623289:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:0.0:1787393170.629691:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393170.630011:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319568768 00000100:00100000:3.0:1787393170.630022:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319568768 00000100:00100000:3.0:1787393170.630087:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:3.0:1787393170.630098:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10422:x1874217319568768:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787393170.630131:0:5821:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787393170.630968:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10422:x1874217319568768:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 869us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393170.630978:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:0.0:1787393170.642750:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393170.643357:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319568896 00000100:00100000:2.0:1787393170.643380:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319568896 00000100:00100000:2.0:1787393170.643483:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:2.0:1787393170.643495:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10422:x1874217319568896:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787393170.643580:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1897 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643598:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1897 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643609:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1897 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643679:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f189e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643687:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f189e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643693:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f189e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643741:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f18a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643751:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f18a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643759:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f18a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393170.643794:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787393170.643798:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787393170.643813:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f18a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643824:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1897 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643830:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1897 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643857:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1897 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643864:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393170.643868:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1897 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643875:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1897 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643887:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9de8184fc100) 00010000:00010000:2.0:1787393170.643896:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393170.643901:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1897 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643907:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1897 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643922:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f189e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643928:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f189e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643934:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f189e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643939:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393170.643942:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f189e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643948:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f189e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643956:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9de818bd8000) 00010000:00010000:2.0:1787393170.643958:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393170.643962:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f189e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643967:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f189e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643980:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f18a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643991:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f18a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.643998:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f18a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.644004:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393170.644008:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f18a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.644014:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f18a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.644024:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8100) 00010000:00010000:2.0:1787393170.644027:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393170.644031:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f18a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.644038:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f18a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393170.644129:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10422:x1874217319568896:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 Request processed in 637us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393170.644137:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:1.0:1787393170.658000:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393170.658050:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319569152 00000100:00100000:1.0:1787393170.658070:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319569152 00000100:00100000:1.0:1787393170.658129:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 70 00000100:00100000:1.0:1787393170.658144:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10422:x1874217319569152:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787393170.658166:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393170.658190:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f18ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d71b expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.659564:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f18b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.659583:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f18b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.659596:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f18b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393170.659608:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787393170.659704:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f18b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.659712:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f18b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.661793:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f18b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.661810:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385ac00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393170.661816:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f18b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.661854:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f18b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.661871:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8100) 00010000:00010000:1.0:1787393170.661874:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787393170.661879:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f18b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.661886:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f18b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.661947:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f18ac lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d71b expref: 23 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.661957:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9de8184fc100) 00010000:00010000:1.0:1787393170.661960:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787393170.661963:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f18ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d71b expref: 23 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.661973:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385a000, rc 0) 00000100:00100000:1.0:1787393170.662037:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+22:10422:x1874217319569152:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 3899us (4047us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1787393170.662047:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 70 00000100:00100000:0.0:1787393170.670896:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393170.670985:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319569280 00000100:00100000:1.0:1787393170.670995:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319569280 00000100:00100000:1.0:1787393170.671067:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 71 00000100:00100000:1.0:1787393170.671077:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+22:10422:x1874217319569280:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787393170.671123:0:5822:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787393170.671245:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+22:10422:x1874217319569280:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 169us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393170.671254:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 71 00000100:00100000:0.0:1787393170.686919:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393170.687066:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319569536 00000100:00100000:1.0:1787393170.687077:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319569536 00000100:00100000:1.0:1787393170.687129:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 72 00000100:00100000:1.0:1787393170.687139:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+22:10422:x1874217319569536:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787393170.687158:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393170.687161:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787393170.687187:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f186d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d70d expref: 22 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.687207:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:1.0:1787393170.687212:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787393170.687238:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f18c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d722 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787393170.687892:0:5821:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787393170.688163:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f18c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.688178:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f18c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.688188:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f18c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.688258:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f18c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d722 expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.688275:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f18c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d722 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.688283:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9de81aa54600) 00010000:00010000:1.0:1787393170.688285:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393170.688288:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385ac00, rc 0) 00000100:00100000:1.0:1787393170.688355:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:10422:x1874217319569536:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 1217us (1446us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787393170.688364:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 72 00000100:00100000:0.0:1787393170.697769:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393170.697816:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319569792 00000100:00100000:1.0:1787393170.697827:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319569792 00000100:00100000:1.0:1787393170.697899:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:1.0:1787393170.697911:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:10422:x1874217319569792:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787393170.697970:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393170.698005:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f18c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d722 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698030:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9de81aa54600) 00010000:00010000:1.0:1787393170.698041:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787393170.698074:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f18d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698092:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f18d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698112:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f18d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698166:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x63661d65 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698175:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x63661d65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698182:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x63661d65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698472:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f18d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698481:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f18d6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698487:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f18d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698493:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393170.698497:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f18d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698504:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f18d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698513:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:1.0:1787393170.698516:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393170.698520:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f18d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698541:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f18d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698555:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x63661d65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698560:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x63661d65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698570:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x63661d65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698576:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385b000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393170.698579:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x63661d65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698585:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x63661d65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698595:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x63661d65 (ffff9de81aa54b00) 00010000:00010000:1.0:1787393170.698598:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393170.698601:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x63661d65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.698607:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x63661d65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393170.698836:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+22:10422:x1874217319569792:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 925us (1074us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787393170.698872:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:1.0:1787393170.702414:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393170.703347:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319569920 00000100:00100000:2.0:1787393170.703359:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319569920 00000100:00100000:2.0:1787393170.703421:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 74 00000100:00100000:2.0:1787393170.703434:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+22:10422:x1874217319569920:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787393170.703455:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393170.703486:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f18e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d729 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.703523:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f18eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.703536:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f18eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.703549:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f18eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.703641:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f18e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d729 expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.703661:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f18eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d729 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393170.703670:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:2.0:1787393170.703674:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787393170.703677:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5200, rc 0) 00000100:00100000:2.0:1787393170.704011:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:10422:x1874217319569920:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 579us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393170.704018:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 74 00000100:00100000:0.0:1787393170.707019:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393170.707115:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319570176 00000100:00100000:3.0:1787393170.707124:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319570176 00000100:00100000:3.0:1787393170.707167:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 75 00000100:00100000:3.0:1787393170.707186:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:10422:x1874217319570176:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787393170.707262:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f18f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393170.707279:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f18f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393170.707292:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f18f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787393170.707570:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1787393170.707580:0:5820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319882740010ns, next at 320882738065ns, rc = 0 00000004:00010000:3.0:1787393170.707668:0:5820:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e55d160 reply state 00000000ca59bab6 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f18f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393170.707678:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787393170.707774:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+25:10422:x1874217319570176:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 597us (760us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1787393170.707782:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 75 00010000:00010000:0.0:1787393170.711912:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f18f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.711943:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f18f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.711951:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f18f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.711957:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393170.711962:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f18f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.711970:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f18f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.711989:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:0.0:1787393170.711993:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787393170.711997:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f18f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.712004:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f18f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393170.714858:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393170.714917:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319570304 00000100:00100000:1.0:1787393170.714927:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319570304 00000100:00100000:1.0:1787393170.714984:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 76 00000100:00100000:1.0:1787393170.715040:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+24:10422:x1874217319570304:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787393170.715070:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393170.715093:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d730 expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.715152:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d730 expref: 25 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.715168:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d730 expref: 25 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.715187:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:1.0:1787393170.715190:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787393170.715195:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385b000, rc 0) 00000100:00100000:1.0:1787393170.715257:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+25:10422:x1874217319570304:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 263us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393170.715264:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 76 00000100:00100000:1.0:1787393170.718614:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393170.718746:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319570432 00000100:00100000:2.0:1787393170.718756:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319570432 00000100:00100000:2.0:1787393170.718794:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:2.0:1787393170.718802:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1874217319570432:12345-192.168.203.21@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787393170.718830:0:7525:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp t0 exp 0000000000000000 cur 319 last 0 00000020:00000080:2.0:1787393170.718891:0:7525:0:(genops.c:1406:class_connect()) connect: client aab0ffcd-9aa3-4dc1-8a02-a1025323dd00, cookie 0x19a927d9c62f1900 00002000:00100000:2.0:1787393170.718902:0:7525:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aab0ffcd-9aa3-4dc1-8a02-a1025323dd00/ffff9de827af4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366d ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787393170.718924:0:7525:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787393170.719153:0:7525:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787393170.719195:0:7525:0:(import.c:65:import_set_state_nolock()) ffff9de827af2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787393170.719272:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2352:x1874217319570432:12345-192.168.203.21@tcp:8:lhsmtool_posix.0 Request processed in 469us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393170.719281:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:0.0:1787393170.722787:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393170.722885:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319570560 00000100:00100000:2.0:1787393170.722896:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319570560 00000100:00100000:2.0:1787393170.722959:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 26 00000100:00100000:2.0:1787393170.722969:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:0:x1874217319570560:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787393170.723107:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787393170.809350:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:0:x1874217319570560:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 86374us (86566us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787393170.809362:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 26 00000001:00080000:2.0:1787393170.809408:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1787393170.809418:0:6648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00000100:00100000:3.0:1787393170.812242:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393170.812319:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319570816 00000100:00100000:2.0:1787393170.812329:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319570816 00000100:00100000:2.0:1787393170.812388:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:2.0:1787393170.812405:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+25:10422:x1874217319570816:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787393170.813083:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+26:10422:x1874217319570816:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 677us (846us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787393170.813093:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:0.0:1787393170.819471:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393170.819507:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319571072 00000100:00100000:0.0:1787393170.819517:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319571072 00000100:00100000:0.0:1787393170.819577:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 77 00000100:00100000:0.0:1787393170.819587:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+26:10422:x1874217319571072:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787393170.819698:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+26:10422:x1874217319571072:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 112us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393170.819715:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 77 00000100:00100000:1.0:1787393170.831302:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393170.835513:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319571200 00000100:00100000:2.0:1787393170.835534:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319571200 00000100:00100000:3.0:1787393170.837624:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 78 00000100:00100000:3.0:1787393170.837637:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+26:10422:x1874217319571200:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787393170.837761:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393170.837783:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1907 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d737 expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393170.837964:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f190e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393170.837979:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f190e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393170.837994:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f190e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393170.838034:0:10433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787393170.838064:0:10433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f190e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393170.838092:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1907 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d737 expref: 28 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393170.838109:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f190e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d737 expref: 27 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393170.838117:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:3.0:1787393170.838120:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787393170.838124:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531600, rc 0) 00000100:00100000:3.0:1787393170.838364:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+27:10422:x1874217319571200:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 729us (7069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393170.838373:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 78 00000100:00100000:0.0:1787393170.854574:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393170.854642:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319571328 00000100:00100000:3.0:1787393170.854651:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319571328 00000100:00100000:3.0:1787393170.854713:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:3.0:1787393170.854725:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2354:x1874217319571328:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787393170.854745:0:6622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393170.854768:0:6622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1915 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d73e expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787393170.854794:0:6622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a897493, blocks: 0x1 00010000:00010000:3.0:1787393170.854811:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1787393170.854815:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393170.854823:0:6622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d73e expref: 6 pid: 6622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393170.854865:0:6622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d73e expref: 6 pid: 6622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393170.854879:0:6622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531c00, rc 0) 00000100:00100000:3.0:1787393170.855121:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2354:x1874217319571328:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 398us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393170.855128:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:0.0:1787393170.858224:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393170.860032:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319571584 00000100:00100000:1.0:1787393170.860046:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319571584 00000100:00100000:1.0:1787393170.860126:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 79 00000100:00100000:1.0:1787393170.860137:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+27:10422:x1874217319571584:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787393170.860350:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+27:10422:x1874217319571584:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 214us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393170.860358:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 79 00000100:00100000:2.0:1787393170.868382:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393170.868521:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319571712 00000100:00100000:0.0:1787393170.868533:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319571712 00000100:00100000:0.0:1787393170.868587:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:0.0:1787393170.868597:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:10422:x1874217319571712:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787393170.868614:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393170.868635:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f191c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d745 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.868677:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1915 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d73e expref: 7 pid: 6622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.868686:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393170.868690:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393170.868695:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f191c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d745 expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.868727:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d73e expref: 7 pid: 6622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.868741:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1915 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d73e expref: 7 pid: 6622 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393170.868755:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6624:1874217338467584:192.168.203.21@tcp:104: 00000100:00100000:0.0:1787393170.869068:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de82d0f53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787393170.876673:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393170.878292:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319571840 00000100:00100000:1.0:1787393170.878305:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319571840 00010000:00010000:1.0:1787393170.878349:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1915 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d73e expref: 8 pid: 6622 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393170.878401:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:1.0:1787393170.878412:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de826cff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2355:x1874217319571840:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393170.878427:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393170.878451:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1915 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d73e expref: 8 pid: 6622 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.878465:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1915 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d73e expref: 8 pid: 6622 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.878492:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393170.878498:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393170.878506:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f191c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d745 expref: 8 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.878515:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f191c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d745 expref: 8 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393170.878554:0:5805:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f191c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d745 expref: 8 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393170.878576:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5805:1874217338467712:192.168.203.21@tcp:105: 00000100:00100000:1.0:1787393170.878671:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83fa72300 going to sleep for 11 seconds 00010000:00010000:0.0:1787393170.879822:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1915 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d73e expref: 8 pid: 6622 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393170.879874:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6624:1874217338467584:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787393170.879901:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f191c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d745 expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393170.879915:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761ca00, rc 0) 00000100:00100000:0.0:1787393170.879994:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:10422:x1874217319571712:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 11397us (11619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393170.880003:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:3.0:1787393170.884994:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5805:1874217338467712:192.168.203.21@tcp:105: 00010000:00010000:3.0:1787393170.885021:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393170.885088:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de826cff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319571840:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 6677us (8425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393170.885099:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:1.0:1787393170.888701:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393170.888836:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319571968 00000100:00100000:2.0:1787393170.888883:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319571968 00002000:00100000:2.0:1787393170.888930:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9de83f5a8e00 x1874217319571968/t0(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:141/0 lens 504/0 e 0 to 0 dl 1787393181 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787393170.888941:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de83f5a8e00 with x1874217319571968 ext(0->8) 00002000:00010000:2.0:1787393170.888946:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de83f5a8e00 00000100:00100000:2.0:1787393170.888974:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:2.0:1787393170.888983:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319571968:12345-192.168.203.21@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787393170.889624:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2355:x1874217319571968:12345-192.168.203.21@tcp:4:lhsmtool_posix.0 Request processed in 639us (930us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787393170.889634:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00002000:00100000:2.0:1787393170.889642:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9de83f5a8e00 x1874217319571968/t4294967302(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:141/0 lens 504/448 e 0 to 0 dl 1787393181 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787393170.889782:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de83f5a8e00 with x1874217319571968 ext(0->8) 00002000:00010000:2.0:1787393170.889788:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de83f5a8e00 00000100:00100000:1.0:1787393170.896059:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393170.897963:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319572096 00000100:00100000:2.0:1787393170.897977:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319572096 00000100:00100000:2.0:1787393170.898043:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 80 00000100:00100000:2.0:1787393170.898064:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+27:10422:x1874217319572096:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1787393170.924505:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393171.030835:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+27:10422:x1874217319572096:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 Request processed in 132775us (134789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393171.030874:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 80 00000001:00080000:3.0:1787393171.031266:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:3.0:1787393171.031284:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:3.0:1787393171.031299:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1787393171.031314:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787393171.031331:0:5842:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:1.0:1787393171.031544:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787393171.031561:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338467840:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787393171.031616:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787393171.032271:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1787393171.032283:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787393171.035157:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338467840 00000100:00100000:3.0:1787393171.035171:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338467840 00000100:00100000:3.0:1787393171.035255:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787393171.035266:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338467840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787393171.035452:0:6622:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787393171.035456:0:6622:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787393171 00002000:00010000:3.0:1787393171.035458:0:6622:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787393171.035460:0:6622:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787393171 -> 1787393171 00002000:00010000:3.0:1787393171.035462:0:6622:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787393171.035538:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3326:x1874217338467840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 275us (3922us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787393171.035546:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1787393171.035596:0:3326:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9de83f5a9180/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787393171.035603:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338467840:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1787393171.035713:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787393171.035888:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393171.035963:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319572224 00000100:00100000:2.0:1787393171.035968:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319572224 00000100:00100000:2.0:1787393171.036005:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:2.0:1787393171.036014:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2353:x1874217319572224:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787393171.129064:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2353:x1874217319572224:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 Request processed in 93032us (93160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393171.129080:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 30 00000001:00080000:2.0:1787393171.129124:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1787393171.129139:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1787393171.134667:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393171.137520:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319572480 00000100:00100000:0.0:1787393171.137535:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319572480 00000100:00100000:0.0:1787393171.140168:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 81 00000100:00100000:0.0:1787393171.140184:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:10422:x1874217319572480:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787393171.140237:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393171.140264:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f190e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d737 expref: 13 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.140285:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:0.0:1787393171.140290:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787393171.140319:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1923 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.140343:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1923 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.140353:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1923 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787393171.140617:0:5822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000535501a2 reply state 00000000e52b50ee transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1923 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393171.140629:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787393171.140733:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:10422:x1874217319572480:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 554us (6074us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787393171.140741:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 81 00000100:00080000:1.0:1787393171.146618:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787393171.149469:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1923 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.149547:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1923 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.149556:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1923 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.149563:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761c200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393171.149568:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1923 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.149575:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1923 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.149592:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:2.0:1787393171.149595:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393171.149607:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1923 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.149613:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1923 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787393171.150463:0:11880:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787393171.150470:0:11880:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787393171.150510:0:11880:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787393171.150516:0:11880:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787393171.151464:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393171.152931:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319572608 00000100:00100000:3.0:1787393171.152945:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319572608 00000100:00100000:3.0:1787393171.153019:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 31 00000100:00100000:3.0:1787393171.153031:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319572608:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787393171.153293:0:6622:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787393171.153303:0:6622:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787393171 -> 1787393170 00002000:00010000:3.0:1787393171.153305:0:6622:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787393168 00002000:00010000:3.0:1787393171.153308:0:6622:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787393171 -> 1787393170 00002000:00010000:3.0:1787393171.153310:0:6622:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787393171.153370:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2355:x1874217319572608:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 341us (1915us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787393171.153378:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 31 00000100:00100000:3.0:1787393171.159136:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393171.159240:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319572864 00000100:00100000:1.0:1787393171.159254:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319572864 00000100:00100000:1.0:1787393171.159323:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 82 00000100:00100000:1.0:1787393171.159334:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:10422:x1874217319572864:12345-192.168.203.21@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787393171.159412:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f192a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.159434:0:10433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f18eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d729 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.159445:0:10433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f192a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.159481:0:10433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f18eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d729 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.159510:0:10433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f18eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d729 expref: 13 pid: 5821 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393171.159529:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338467968:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393171.159613:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501f900 going to sleep for 11 seconds 00000100:00100000:1.0:1787393171.174970:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338467968:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393171.174997:0:10433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f192a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393171.184989:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393171.190239:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319572992 00000100:00100000:3.0:1787393171.190255:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319572992 00010000:00010000:3.0:1787393171.190483:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f18eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d729 expref: 14 pid: 5821 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393171.190532:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:3.0:1787393171.190543:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:2355:x1874217319572992:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787393171.190558:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393171.190565:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f18eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d729 expref: 14 pid: 5821 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393171.190577:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f18eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d729 expref: 14 pid: 5821 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393171.190597:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f18eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d729 expref: 14 pid: 5821 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393171.190610:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:3.0:1787393171.190614:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f192a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393171.191370:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f192a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393171.191379:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f192a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.192008:0:10433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f192a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.192018:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f192a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.192229:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f192a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.192238:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f192a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.192244:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f192a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.192250:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393171.192255:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f192a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.192263:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f192a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.192275:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:2.0:1787393171.192278:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787393171.192282:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f192a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.192287:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f192a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393171.192383:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:10422:x1874217319572864:12345-192.168.203.21@tcp:55:lhsmtool_posix.0 Request processed in 33049us (33253us total) trans 0 rc -22/-22 00010000:00010000:3.0:1787393171.192389:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393171.192393:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 82 00000100:00100000:2.0:1787393171.192551:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+12:2355:x1874217319572992:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 2009us (7571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393171.192559:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:1.0:1787393171.203092:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393171.203177:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319573120 00000100:00100000:0.0:1787393171.203186:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319573120 00000100:00100000:0.0:1787393171.203243:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00100000:0.0:1787393171.203253:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2356:x1874217319573120:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787393171.203297:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f1931 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.205033:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f191c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d745 expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.205059:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393171.205064:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787393171.205071:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f1931 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.205120:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f191c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d745 expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.205136:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f191c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d745 expref: 7 pid: 6624 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393171.205152:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6624:1874217338468096:192.168.203.21@tcp:104: 00000100:00100000:0.0:1787393171.205241:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80fcb4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787393171.217408:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393171.217415:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6624:1874217338468096:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787393171.217443:0:6624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f1931 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393171.218375:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319573248 00000100:00100000:1.0:1787393171.218383:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319573248 00010000:00010000:1.0:1787393171.218418:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f191c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d745 expref: 8 pid: 6624 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393171.218459:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 44 00000100:00100000:1.0:1787393171.218469:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2356:x1874217319573248:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393171.218482:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393171.218503:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f191c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d745 expref: 8 pid: 6624 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.218516:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f191c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d745 expref: 8 pid: 6624 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.218552:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f191c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d745 expref: 8 pid: 6624 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.218568:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787393171.218573:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787393171.218578:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f1931 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.218589:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f1931 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.218613:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393171.218658:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2356:x1874217319573248:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 190us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393171.218666:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 44 00010000:00010000:1.0:1787393171.219820:0:6624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f1931 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.219833:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f1931 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.219890:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f1931 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.219900:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f1931 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.219919:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f1931 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.219927:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761c800 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:1.0:1787393171.219931:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f1931 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.219939:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f1931 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.219954:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f1931 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.219960:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f1931 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393171.220092:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2356:x1874217319573120:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 Request processed in 16837us (17004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393171.220102:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00100000:3.0:1787393171.230428:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393171.230489:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319573504 00000100:00100000:0.0:1787393171.230499:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319573504 00000100:00100000:0.0:1787393171.230559:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 83 00000100:00100000:0.0:1787393171.230569:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+12:10422:x1874217319573504:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787393171.230644:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1938 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.230661:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1938 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.230673:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1938 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.230909:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f193f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.230941:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d730 expref: 13 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.230951:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f193f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.230984:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d730 expref: 13 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.230998:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d730 expref: 13 pid: 10433 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393171.231013:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca86300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1874217338468224:192.168.203.21@tcp:104: 00000100:00100000:0.0:1787393171.231106:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80fcb4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787393171.233098:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca86300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1874217338468224:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393171.233128:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f193f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393171.233402:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393171.233573:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319573632 00000100:00100000:2.0:1787393171.233579:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319573632 00010000:00010000:2.0:1787393171.233609:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d730 expref: 14 pid: 10433 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393171.233641:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:2.0:1787393171.233649:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:2356:x1874217319573632:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393171.233663:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393171.233669:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d730 expref: 14 pid: 10433 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.233681:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d730 expref: 14 pid: 10433 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.233704:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f18f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d730 expref: 14 pid: 10433 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.233720:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:2.0:1787393171.233724:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f193f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.233743:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f193f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.233750:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f193f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.233772:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393171.233817:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:2356:x1874217319573632:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 168us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393171.233825:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 45 00010000:00010000:2.0:1787393171.233939:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f193f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.233946:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f193f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787393171.234123:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1787393171.234270:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787393171.234316:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1787393171.234408:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c684000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5822:1874217338468352:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787393171.234450:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393171.234474:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de803ea1780 going to sleep for 11 seconds 00000100:00100000:2.0:1787393171.234492:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338468352 00000100:00100000:2.0:1787393171.234496:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338468352 00000100:00100000:2.0:1787393171.234528:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787393171.234535:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1874217338468352:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787393171.234589:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1874217338468352:12345-0@lo:1000:mdt00_002.0 Request processed in 55us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393171.234595:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787393171.234634:0:5822:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787393171.234639:0:5822:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9de83f5a9180, transno 4294967303 00000100:00100000:2.0:1787393171.234649:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c684000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5822:1874217338468352:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787393171.235035:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1787393171.235090:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c684000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5822:1874217338468480:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787393171.235113:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393171.235127:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de811601780 going to sleep for 11 seconds 00000100:00100000:2.0:1787393171.235282:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338468480 00000100:00100000:2.0:1787393171.235286:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338468480 00000100:00100000:2.0:1787393171.235309:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787393171.235315:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1874217338468480:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787393171.235443:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5822:x1874217338468480:12345-0@lo:1000:mdt00_002.0 Request processed in 127us (328us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787393171.235450:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787393171.235484:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c684000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5822:1874217338468480:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787393171.235511:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f193f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235520:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f193f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235526:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f193f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235533:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761d400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393171.235536:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f193f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235543:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f193f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235564:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:2.0:1787393171.235566:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787393171.235570:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f193f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235575:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f193f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235606:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1874 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235612:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1874 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235617:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1874 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235621:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393171.235624:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1874 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235629:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1874 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235635:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8100) 00010000:00010000:2.0:1787393171.235637:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787393171.235639:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1874 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235645:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1874 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235676:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1946 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235689:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1890 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d714 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235698:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1946 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235722:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1890 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d714 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.235734:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1890 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d714 expref: 16 pid: 5820 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393171.235744:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1874217338468608:192.168.203.21@tcp:104: 00000100:00100000:2.0:1787393171.235795:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8181c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787393171.240810:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1874217338468608:192.168.203.21@tcp:104: 00010000:00010000:2.0:1787393171.243293:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1946 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393171.251260:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393171.251342:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319573760 00000100:00100000:0.0:1787393171.251352:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319573760 00010000:00010000:0.0:1787393171.251389:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1890 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d714 expref: 17 pid: 5820 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393171.251430:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00100000:0.0:1787393171.251439:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+17:2355:x1874217319573760:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787393171.251451:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393171.251458:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1890 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d714 expref: 17 pid: 5820 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.251470:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1890 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d714 expref: 17 pid: 5820 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.251498:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1890 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d714 expref: 17 pid: 5820 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.251512:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8100) 00010000:00010000:0.0:1787393171.251517:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1946 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.251526:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1946 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.251533:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1946 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393171.251563:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393171.251616:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+16:2355:x1874217319573760:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 178us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393171.251623:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 46 00010000:00010000:1.0:1787393171.251680:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1946 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.251688:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1946 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.251698:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1946 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.251711:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1946 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.251717:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1946 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.251722:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393171.251726:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1946 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.251733:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1946 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.251742:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8100) 00010000:00010000:1.0:1787393171.251745:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393171.251748:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1946 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.251753:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1946 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.251763:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1938 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.251768:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1938 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.251773:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1938 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.251778:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761d000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393171.251787:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1938 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.251793:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1938 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.251801:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8100) 00010000:00010000:1.0:1787393171.251803:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787393171.251805:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1938 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393171.251811:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1938 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393171.252032:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:10422:x1874217319573504:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 21463us (21613us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1787393171.252041:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 83 00000020:00080000:1.0:1787393171.252045:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787393171.253025:0:11566:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787393171.253031:0:11566:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787393171.253069:0:11566:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787393171.253075:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787393171.258339:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393171.258417:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319574016 00000100:00100000:2.0:1787393171.258428:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319574016 00000100:00100000:2.0:1787393171.258488:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:2.0:1787393171.258497:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:10422:x1874217319574016:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787393171.259149:0:5823:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787393171.259247:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787393171.259300:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f194d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.259317:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f194d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.259328:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f194d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.259337:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f194d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.259343:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f194d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.259349:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f194d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.259367:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787393171.259453:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+17:10422:x1874217319574016:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 956us (1121us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787393171.259462:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 20 00000020:00080000:2.0:1787393171.259467:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787393171.259488:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787393171.259494:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f194d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.259501:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4800 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393171.259506:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f194d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.259513:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f194d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.259531:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:2.0:1787393171.259533:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787393171.259537:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f194d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.259543:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f194d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393171.259559:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393171.259560:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393171.259562:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393171.947387:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393172.970497:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787393172.983015:0:11931:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787393172.983023:0:11931:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787393172.990439:0:11931:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787393172.990450:0:11931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787393173.113082:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393173.113150:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319574272 00000100:00100000:3.0:1787393173.113160:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319574272 00000100:00100000:3.0:1787393173.113230:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 84 00000100:00100000:3.0:1787393173.113240:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+17:10441:x1874217319574272:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1787393173.113263:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393173.113282:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1954 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d74c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.113536:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f195b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.113551:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f195b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.113571:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f195b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393173.113583:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787393173.113744:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1954 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d74c expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.113760:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f195b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d74c expref: 19 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.113768:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:3.0:1787393173.113771:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787393173.113774:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531e00, rc 0) 00000100:00100000:3.0:1787393173.113831:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:10441:x1874217319574272:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 592us (757us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787393173.113869:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 84 00000100:00080000:1.0:1787393173.114137:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787393173.123193:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393173.123253:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319574400 00000100:00100000:0.0:1787393173.123263:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319574400 00000100:00100000:0.0:1787393173.123319:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 85 00000100:00100000:0.0:1787393173.123329:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:10441:x1874217319574400:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:0.0:1787393173.123414:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1969 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123442:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1969 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123454:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1969 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123470:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f1970 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123477:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f1970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123483:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f1970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123750:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1977 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123759:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123766:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787393173.123801:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123814:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1969 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123820:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1969 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123885:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1969 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123892:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761d400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393173.123896:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1969 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123909:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1969 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123919:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:0.0:1787393173.123922:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393173.123925:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1969 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123931:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1969 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123940:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f1970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123946:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f1970 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123951:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f1970 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123955:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761c800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393173.123957:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f1970 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123972:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f1970 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123979:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de803da2b00) 00010000:00010000:0.0:1787393173.123981:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393173.123984:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f1970 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.123989:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f1970 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.124001:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.124006:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1977 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.124011:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1977 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.124015:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761ca00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393173.124017:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1977 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.124022:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1977 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.124028:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de803da2100) 00010000:00010000:0.0:1787393173.124030:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393173.124032:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1977 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.124060:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1977 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393173.124129:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:10441:x1874217319574400:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 800us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393173.124137:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 85 00000100:00100000:3.0:1787393173.186195:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393173.187382:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319574656 00000100:00100000:2.0:1787393173.187401:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319574656 00000100:00100000:2.0:1787393173.187505:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 86 00000100:00100000:2.0:1787393173.187515:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:10444:x1874217319574656:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1787393173.187533:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393173.187553:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f197e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d753 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.187639:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1985 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.187653:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1985 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.187672:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1985 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.187699:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f198c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.187706:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f198c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.187713:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f198c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188129:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1993 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188138:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188145:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393173.188154:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787393173.188238:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1985 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188259:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1985 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188266:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1985 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188272:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393173.188277:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1985 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188295:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1985 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188307:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:2.0:1787393173.188310:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393173.188314:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1985 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188320:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1985 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188335:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f198c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188342:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f198c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188347:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f198c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188352:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393173.188355:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f198c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188360:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f198c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188367:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de818bd8000) 00010000:00010000:2.0:1787393173.188369:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393173.188372:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f198c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188386:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f198c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188425:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f197e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d753 expref: 22 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188439:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d753 expref: 21 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.188446:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:2.0:1787393173.188448:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787393173.188451:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5400, rc 0) 00000100:00100000:2.0:1787393173.188521:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10444:x1874217319574656:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1007us (2335us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787393173.188528:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 86 00000100:00100000:0.0:1787393173.199408:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393173.201402:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319574784 00000100:00100000:2.0:1787393173.201415:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319574784 00000100:00100000:3.0:1787393173.201884:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 87 00000100:00100000:3.0:1787393173.201896:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10444:x1874217319574784:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:3.0:1787393173.201973:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f19a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.201989:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f19a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.202000:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f19a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.202055:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f19a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.202063:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f19a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.202071:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f19a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.202076:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393173.202080:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f19a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.202087:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f19a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.202097:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:3.0:1787393173.202100:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787393173.202104:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f19a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.202109:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f19a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393173.202181:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10444:x1874217319574784:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 286us (2781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393173.202189:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 87 00000100:00100000:3.0:1787393173.206326:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393173.206460:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319575040 00000100:00100000:2.0:1787393173.206469:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319575040 00000100:00100000:2.0:1787393173.206522:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:2.0:1787393173.206532:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818e69850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10444:x1874217319575040:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1787393173.206939:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818e69850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+22:10444:x1874217319575040:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 407us (620us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787393173.206947:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:0.0:1787393173.244227:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393173.244343:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319575296 00000100:00100000:1.0:1787393173.244353:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319575296 00000100:00100000:1.0:1787393173.244404:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 88 00000100:00100000:1.0:1787393173.244413:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+22:9964:x1874217319575296:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:1.0:1787393173.244435:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393173.244454:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f19a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d75a expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.244610:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f19af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.244624:0:10433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1993 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d753 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.244632:0:10433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f19af lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.244662:0:10433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d753 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.244675:0:10433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1993 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d753 expref: 23 pid: 5821 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393173.244688:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338468736:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393173.244774:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787393173.247551:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393173.248132:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338468736:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393173.248156:0:10433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f19af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393173.248331:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319575424 00000100:00100000:3.0:1787393173.248337:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319575424 00010000:00010000:3.0:1787393173.248384:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1993 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d753 expref: 24 pid: 5821 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393173.248421:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:3.0:1787393173.248431:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+24:2356:x1874217319575424:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787393173.248445:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393173.248451:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1993 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d753 expref: 24 pid: 5821 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.248463:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d753 expref: 24 pid: 5821 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.248483:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f1993 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d753 expref: 24 pid: 5821 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.248499:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:3.0:1787393173.248504:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f19af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.248512:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f19af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.248520:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f19af lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.248545:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393173.248599:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:2356:x1874217319575424:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 169us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393173.248607:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 47 00010000:00010000:1.0:1787393173.248669:0:10433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f19af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.248677:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f19af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393173.248694:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787393173.248828:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f19a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d75a expref: 24 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.248888:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f19af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d75a expref: 23 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.248896:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:1.0:1787393173.248899:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787393173.248901:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385be00, rc 0) 00000100:00100000:1.0:1787393173.248926:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:9964:x1874217319575296:12345-192.168.203.21@tcp:101:bash.0 Request processed in 4515us (4709us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787393173.248933:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 88 00000100:00100000:3.0:1787393173.252001:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393173.252094:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319575680 00000100:00100000:2.0:1787393173.252104:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319575680 00000100:00100000:2.0:1787393173.252175:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 89 00000100:00100000:2.0:1787393173.252184:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:9964:x1874217319575680:12345-192.168.203.21@tcp:36:bash.0 00010000:00010000:2.0:1787393173.252439:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f19bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.252456:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f19bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.252468:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f19bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787393173.252519:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1787393173.252543:0:5822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ecab720 reply state 0000000012b52f4b transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f19bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393173.252553:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787393173.252599:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1787393173.252698:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+27:9964:x1874217319575680:12345-192.168.203.21@tcp:36:bash.0 Request processed in 515us (704us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787393173.252706:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 89 00000020:00080000:2.0:1787393173.252711:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787393173.257714:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393173.258232:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319575808 00000100:00100000:2.0:1787393173.258244:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319575808 00000100:00100000:2.0:1787393173.258301:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 90 00000100:00100000:2.0:1787393173.258310:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+27:9964:x1874217319575808:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1787393173.258345:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393173.258364:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f19c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d761 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.258421:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f19c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d761 expref: 28 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.258449:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f19c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d761 expref: 28 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.258468:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:2.0:1787393173.258471:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787393173.258474:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4e00, rc 0) 00000100:00100000:2.0:1787393173.258533:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+28:9964:x1874217319575808:12345-192.168.203.21@tcp:101:bash.0 Request processed in 224us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393173.258540:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 90 00010000:00010000:0.0:1787393173.259609:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f19bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.259621:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f19bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.259629:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f19bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.259635:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393173.259639:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f19bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.259648:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f19bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.259662:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:0.0:1787393173.259665:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393173.259669:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f19bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.259695:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f19bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393173.264901:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393173.264994:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319575936 00000100:00100000:3.0:1787393173.265003:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319575936 00000100:00100000:3.0:1787393173.265079:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:3.0:1787393173.265089:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:9964:x1874217319575936:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1787393173.265106:0:6622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393173.265127:0:6622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fecd5b7/0x19a927d9c62f19cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d768 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787393173.265151:0:6622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a897492, atime: 0x6a897490, ctime: 0x6a897492, blocks: 0xb 00010000:00010000:3.0:1787393173.265180:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=322s v=(0 0) 00010000:00010000:3.0:1787393173.265184:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393173.265191:0:6622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fecd5b7/0x19a927d9c62f19cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d768 expref: 7 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.265206:0:6622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fecd5b7/0x19a927d9c62f19cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d768 expref: 7 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.265218:0:6622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531600, rc 0) 00000100:00100000:3.0:1787393173.265273:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:9964:x1874217319575936:12345-192.168.203.21@tcp:101:bash.0 Request processed in 186us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393173.265280:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00080000:1.0:1787393173.266009:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787393173.271096:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393173.273324:0:6628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319576064 00000100:00100000:0.0:1787393173.273337:0:6628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319576064 00002000:00010000:0.0:1787393173.273384:0:6628:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787393173.273389:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de83f5f4380 with x1874217319576064 ext(0->18446744073709551615) 00002000:00010000:0.0:1787393173.273401:0:6628:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de83f5f4380. 00000100:00100000:0.0:1787393173.273438:0:6628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:0.0:1787393173.273448:0:6628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2356:x1874217319576064:12345-192.168.203.21@tcp:10:bash.0 00002000:00010000:0.0:1787393173.273700:0:6628:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787393173.273704:0:6628:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787393170 -> 1787393173 00002000:00010000:0.0:1787393173.273707:0:6628:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787393168 -> 1787393168 00002000:00010000:0.0:1787393173.273710:0:6628:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787393170 -> 1787393173 00002000:00010000:0.0:1787393173.273713:0:6628:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787393173.273777:0:6628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2356:x1874217319576064:12345-192.168.203.21@tcp:10:bash.0 Request processed in 330us (2690us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787393173.273785:0:6628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 1 00002000:00010000:0.0:1787393173.273789:0:6628:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787393173.273791:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de83f5f4380 with x1874217319576064 ext(0->18446744073709551615) 00002000:00010000:0.0:1787393173.273796:0:6628:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de83f5f4380. 00000100:00100000:0.0:1787393173.337619:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393173.337669:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393173.337762:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319576320 00000100:00100000:1.0:1787393173.337772:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319576320 00000100:00100000:1.0:1787393173.337830:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:1.0:1787393173.337869:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2353:x1874217319576320:12345-192.168.203.21@tcp:16:kworker.0 00000100:00100000:2.0:1787393173.338882:0:6629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319576192 00000100:00100000:2.0:1787393173.338890:0:6629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319576192 00002000:00100000:2.0:1787393173.338927:0:6629:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff9de83ca86680 x1874217319576192/t0(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:144/0 lens 496/0 e 0 to 0 dl 1787393184 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787393173.338937:0:6629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de83ca86680 with x1874217319576192 ext(0->7) 00002000:00010000:2.0:1787393173.338942:0:6629:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de83ca86680 00000100:00100000:2.0:1787393173.339099:0:6629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:2.0:1787393173.339109:0:6629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:2353:x1874217319576192:12345-192.168.203.21@tcp:4:bash.0 00000100:00100000:2.0:1787393173.339509:0:6629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+11:2353:x1874217319576192:12345-192.168.203.21@tcp:4:bash.0 Request processed in 400us (1897us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787393173.339517:0:6629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 2 00002000:00100000:2.0:1787393173.339523:0:6629:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff9de83ca86680 x1874217319576192/t4294967307(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:144/0 lens 496/448 e 0 to 0 dl 1787393184 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787393173.339530:0:6629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de83ca86680 with x1874217319576192 ext(0->7) 00002000:00010000:2.0:1787393173.339540:0:6629:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de83ca86680 00000100:00100000:0.0:1787393173.362349:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393173.362384:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393173.362746:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393173.362824:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319576704 00000100:00100000:1.0:1787393173.362834:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319576704 00000100:00100000:1.0:1787393173.362914:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 127 00000100:00100000:1.0:1787393173.362923:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319576704:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393173.362997:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319576704:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 74us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393173.363006:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 127 00000100:00100000:3.0:1787393173.363190:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319576576 00000100:00100000:3.0:1787393173.363195:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319576576 00000100:00100000:3.0:1787393173.363224:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:3.0:1787393173.363231:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2355:x1874217319576576:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393173.363270:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2355:x1874217319576576:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 39us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393173.363276:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00080000:0.0:1787393173.363867:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787393173.363872:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787393173.363973:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319576448 00000100:00100000:2.0:1787393173.363978:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319576448 00000100:00100000:2.0:1787393173.364008:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 283 00000100:00100000:2.0:1787393173.364016:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319576448:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393173.364068:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319576448:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 53us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393173.364075:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 283 00000100:00100000:3.0:1787393173.383157:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393173.383193:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319576832 00000100:00100000:3.0:1787393173.383203:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319576832 00000100:00100000:3.0:1787393173.383250:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 91 00000100:00100000:3.0:1787393173.383261:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+27:10458:x1874217319576832:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:3.0:1787393173.383327:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f19d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383343:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f19d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383354:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f19d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383368:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f19d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383374:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f19d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383380:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f19d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383616:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f19e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383625:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f19e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383638:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f19e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787393173.383674:0:10433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f19e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383685:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f19d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383691:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f19d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383698:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f19d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383704:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393173.383708:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f19d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383715:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f19d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383725:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:3.0:1787393173.383728:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393173.383732:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f19d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383738:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f19d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383750:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f19d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383760:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f19d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383766:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f19d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383771:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393173.383774:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f19d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383780:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f19d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383787:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de8063da200) 00010000:00010000:3.0:1787393173.383789:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393173.383792:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f19d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.383797:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f19d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.387007:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f19e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.387024:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f19e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.387040:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f19e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.387047:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393173.387059:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f19e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.387068:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f19e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.387085:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:3.0:1787393173.387087:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393173.387092:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f19e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.387098:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f19e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393173.387202:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+27:10458:x1874217319576832:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 3939us (4049us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393173.387212:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 91 00000001:00080000:2.0:1787393173.424598:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:2.0:1787393173.424622:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1787393173.433832:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:3.0:1787393173.433866:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1787393173.434097:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2353:x1874217319576320:12345-192.168.203.21@tcp:16:kworker.0 Request processed in 96254us (96421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393173.434123:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:3.0:1787393173.445075:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393173.445183:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319577088 00000100:00100000:1.0:1787393173.445193:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319577088 00000100:00100000:1.0:1787393173.445250:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 92 00000100:00100000:1.0:1787393173.445261:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+27:10461:x1874217319577088:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393173.445282:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393173.445304:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f19e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d76f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.445437:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f19ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.445451:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f19ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.445463:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f19ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.445477:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f19f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.445484:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f19f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.445491:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f19f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.445800:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f19fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.445820:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f19fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.445828:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f19fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393173.446054:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787393173.446153:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f19ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.446160:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f19ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.446167:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f19ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.446173:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385ae00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393173.446177:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f19ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.446185:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f19ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.446197:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:1.0:1787393173.446200:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393173.446204:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f19ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.446211:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f19ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.446221:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f19f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.446233:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f19f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.446239:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f19f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.446244:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385aa00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393173.446247:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f19f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.446253:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f19f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.446261:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de81aa54e00) 00010000:00010000:1.0:1787393173.446263:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393173.446266:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f19f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.446272:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f19f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.446707:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f19e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d76f expref: 30 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.446727:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f19fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d76f expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.446734:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:1.0:1787393173.446736:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787393173.446745:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385a000, rc 0) 00000100:00100000:1.0:1787393173.446926:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+29:10461:x1874217319577088:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1666us (1859us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787393173.446935:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 92 00000100:00100000:0.0:1787393173.450074:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393173.450350:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319577216 00000100:00100000:2.0:1787393173.450359:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319577216 00000100:00100000:2.0:1787393173.450411:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 93 00000100:00100000:2.0:1787393173.450421:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+29:10461:x1874217319577216:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:2.0:1787393173.450485:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1a0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.450500:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f19af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d75a expref: 29 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.450509:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1a0a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.450542:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f19af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d75a expref: 29 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.450556:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f19af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d75a expref: 29 pid: 10433 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393173.450588:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de80ba18000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1874217338468864:192.168.203.21@tcp:104: 00000100:00100000:2.0:1787393173.450680:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de701b71180 going to sleep for 11 seconds 00000100:00100000:2.0:1787393173.455017:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393173.455118:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319577472 00000100:00100000:1.0:1787393173.455128:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319577472 00000100:00100000:1.0:1787393173.455190:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:1.0:1787393173.455201:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+30:5566:x1874217319577472:12345-192.168.203.21@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787393173.455496:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+31:5566:x1874217319577472:12345-192.168.203.21@tcp:35:ldlm_bl.0 Request processed in 295us (486us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787393173.455505:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:0.0:1787393173.455747:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de80ba18000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1874217338468864:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787393173.455773:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1a0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393173.458347:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393173.458515:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319577600 00000100:00100000:3.0:1787393173.458529:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319577600 00010000:00010000:3.0:1787393173.458569:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f19af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d75a expref: 31 pid: 10433 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393173.458646:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:3.0:1787393173.458661:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+31:2356:x1874217319577600:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787393173.458675:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393173.458682:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f19af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d75a expref: 31 pid: 10433 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.458714:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f19af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d75a expref: 31 pid: 10433 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.458736:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f19af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d75a expref: 31 pid: 10433 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.458750:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:3.0:1787393173.458755:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1a0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.458764:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1a0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.458769:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1a0a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.458792:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787393173.458818:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1a0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.458826:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1a0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393173.458910:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+30:2356:x1874217319577600:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 250us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393173.458918:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 48 00010000:00010000:0.0:1787393173.458963:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1a0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.458971:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1a0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.458977:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1a0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.458983:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393173.458987:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1a0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.458993:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1a0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.459002:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:0.0:1787393173.459011:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787393173.459015:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1a0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.459021:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1a0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393173.459073:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+29:10461:x1874217319577216:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 8653us (9007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393173.459081:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 93 00000100:00100000:0.0:1787393173.461049:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393173.461322:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319577856 00000100:00100000:1.0:1787393173.461330:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319577856 00000100:00100000:1.0:1787393173.461379:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:1.0:1787393173.461389:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+29:10461:x1874217319577856:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1787393173.462018:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+30:10461:x1874217319577856:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 629us (984us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787393173.462027:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:2.0:1787393173.578286:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393173.580232:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319578112 00000100:00100000:3.0:1787393173.580244:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319578112 00000100:00100000:3.0:1787393173.580393:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 94 00000100:00100000:3.0:1787393173.580404:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+30:10472:x1874217319578112:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:1.0:1787393173.580490:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393173.580513:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1a11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d776 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.580585:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.580599:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.580636:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.580652:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.580659:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.580666:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581010:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1a26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581020:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581027:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393173.581052:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787393173.581141:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581149:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581155:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581161:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385aa00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393173.581171:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581178:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581190:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:1.0:1787393173.581193:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393173.581196:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581202:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581213:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581219:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581225:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581231:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385ae00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393173.581234:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581239:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581246:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de81aa54e00) 00010000:00010000:1.0:1787393173.581249:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393173.581258:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581264:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581302:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1a11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d776 expref: 33 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581316:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1a26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d776 expref: 32 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.581323:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:1.0:1787393173.581325:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393173.581327:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385ac00, rc 0) 00000100:00100000:1.0:1787393173.581393:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+32:10472:x1874217319578112:12345-192.168.203.21@tcp:101:cat.0 Request processed in 991us (3116us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787393173.581402:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 94 00000100:00100000:0.0:1787393173.591062:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393173.591204:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319578368 00000100:00100000:2.0:1787393173.591219:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319578368 00000100:00100000:2.0:1787393173.591291:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 24 00000100:00100000:2.0:1787393173.591306:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+32:10472:x1874217319578368:12345-192.168.203.21@tcp:35:cat.0 00000100:00100000:2.0:1787393173.591555:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+33:10472:x1874217319578368:12345-192.168.203.21@tcp:35:cat.0 Request processed in 250us (501us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787393173.591563:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 24 00000100:00100000:0.0:1787393173.613920:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393173.614243:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319578624 00000100:00100000:3.0:1787393173.614268:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319578624 00000100:00100000:3.0:1787393173.614341:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 95 00000100:00100000:3.0:1787393173.614352:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+33:10473:x1874217319578624:12345-192.168.203.21@tcp:36:rm.0 00010000:00010000:3.0:1787393173.614423:0:10433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787393173.614451:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1a26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d776 expref: 33 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.614471:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f19fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d76f expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.614491:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f19c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d761 expref: 31 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.614504:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:3.0:1787393173.614522:0:10433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787393173.614543:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1a34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.614557:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1a34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.614568:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1a34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.614582:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1a3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.614588:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1a3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.614595:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1a3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.614938:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1a42 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.614948:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1a42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.614955:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1a42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787393173.615565:0:10433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1787393173.615575:0:10433:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322790735460ns, next at 323790733016ns, rc = 0 00010000:00010000:3.0:1787393173.615630:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1a49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.615641:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1a49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.615648:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1a49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.615656:0:10433:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1a49 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.615663:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1a49 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.615669:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1a49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.616005:0:10433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787393173.616026:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1a42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.616051:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1a42 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.616057:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1a42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.616061:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393173.616065:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1a42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.616071:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1a42 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.616081:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de8063da800) 00010000:00010000:3.0:1787393173.616083:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787393173.616086:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1a42 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.616091:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1a42 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.616108:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1a34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.616113:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1a34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.616118:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1a34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.616122:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393173.616129:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1a34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.616135:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1a34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.616141:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:3.0:1787393173.616143:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393173.616146:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1a34 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.616151:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1a34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787393173.616159:0:10433:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005e6f96ad reply state 0000000079fa3a53 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1a3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393173.616167:0:10433:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787393173.616251:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+32:10473:x1874217319578624:12345-192.168.203.21@tcp:36:rm.0 Request processed in 1898us (2338us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787393173.616313:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 95 00010000:00010000:2.0:1787393173.620628:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787393173.620642:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1a49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.620653:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531800 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393173.620658:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1a49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.620667:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1a49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.620685:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9de8063da800) 00010000:00010000:2.0:1787393173.620688:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787393173.620693:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1a49 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.620720:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1a49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.620745:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393173.620747:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393173.620749:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393173.623756:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1a3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.623772:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1a3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.623779:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1a3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.623784:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393173.623789:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1a3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.623796:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1a3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.623811:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de8063da200) 00010000:00010000:0.0:1787393173.623813:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393173.623826:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1a3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.623832:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1a3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393173.668080:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393173.668430:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319578880 00000100:00100000:1.0:1787393173.668441:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319578880 00000100:00100000:1.0:1787393173.668504:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 96 00000100:00100000:1.0:1787393173.668515:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+31:10479:x1874217319578880:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:1.0:1787393173.668541:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393173.668562:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1a50 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d77d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.668701:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a57 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.668733:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.668744:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.668759:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.668766:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.668787:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787393173.669359:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787393173.669528:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1a65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.669540:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1a65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.669555:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1a65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.669588:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.669595:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a57 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.669602:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a57 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.669615:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385ae00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393173.669619:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a57 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.669626:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a57 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.669638:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:1.0:1787393173.669640:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393173.669645:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.669651:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1a57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787393173.669664:0:5822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f9a47848 reply state 00000000be503770 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393173.669671:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787393173.669700:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1a50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d77d expref: 34 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.669712:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1a65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d77d expref: 33 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.669719:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54600) 00010000:00010000:1.0:1787393173.669721:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393173.669723:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385a800, rc 0) 00000100:00100000:1.0:1787393173.669797:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+34:10479:x1874217319578880:12345-192.168.203.21@tcp:101:bash.0 Request processed in 1284us (1726us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787393173.669810:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 96 00000100:00100000:3.0:1787393173.675505:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393173.676478:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319579008 00000100:00100000:1.0:1787393173.676489:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319579008 00000100:00100000:1.0:1787393173.676546:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00100000:1.0:1787393173.676557:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2354:x1874217319579008:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:1.0:1787393173.676576:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393173.676598:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1a73 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d784 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787393173.676636:0:6624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393173.676655:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=322s v=(0 0) 00010000:00010000:1.0:1787393173.676660:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393173.676669:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1a73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d784 expref: 6 pid: 6624 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.676686:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1a73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d784 expref: 6 pid: 6624 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.676699:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385a400, rc 0) 00000100:00100000:1.0:1787393173.676765:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2354:x1874217319579008:12345-192.168.203.21@tcp:101:bash.0 Request processed in 209us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393173.676772:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 35 00010000:00010000:0.0:1787393173.678227:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.678242:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.678249:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.678256:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385aa00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393173.678261:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.678269:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.678286:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de81aa54e00) 00010000:00010000:0.0:1787393173.678289:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393173.678293:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.678300:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1a5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393173.682799:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393173.682894:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319579136 00000100:00100000:3.0:1787393173.682911:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319579136 00000100:00100000:3.0:1787393173.682964:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:3.0:1787393173.682975:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:10479:x1874217319579136:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1787393173.682992:0:7525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393173.683013:0:7525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1a7a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d78b expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.683074:0:7525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1a73 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d784 expref: 7 pid: 6624 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.683083:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393173.683087:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393173.683093:0:7525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1a7a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d78b expref: 7 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.683124:0:7525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1a73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d784 expref: 7 pid: 6624 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.683138:0:7525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1a73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d784 expref: 7 pid: 6624 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393173.683153:0:7525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8180aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7525:1874217338468992:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393173.683384:0:7525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818104b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787393173.686779:0:7525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8180aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7525:1874217338468992:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393173.686814:0:7525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1a7a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d78b expref: 7 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.686870:0:7525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531a00, rc 0) 00000100:00100000:3.0:1787393173.686933:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:10479:x1874217319579136:12345-192.168.203.21@tcp:101:bash.0 Request processed in 3959us (4143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393173.686943:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:3.0:1787393173.687456:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393173.687683:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319579264 00000100:00100000:1.0:1787393173.687691:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319579264 00010000:00010000:1.0:1787393173.687726:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1a73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d784 expref: 7 pid: 6624 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393173.687787:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:3.0:1787393173.687795:0:5805:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787393173.687801:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de826cff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2356:x1874217319579264:12345-192.168.203.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787393173.687808:0:5805:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787393173.687817:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393173.687878:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1a73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d784 expref: 7 pid: 6624 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.687893:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1a73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d784 expref: 7 pid: 6624 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.687916:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1a73 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d784 expref: 7 pid: 6624 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.687930:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393173.687935:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393173.687943:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1a7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d78b expref: 6 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.687955:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1a7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d78b expref: 6 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.687990:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1a7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d78b expref: 6 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393173.688005:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5806:1874217338469120:192.168.203.21@tcp:105: 00000100:00100000:1.0:1787393173.688088:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501f780 going to sleep for 11 seconds 00000100:00100000:1.0:1787393173.690475:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5806:1874217338469120:192.168.203.21@tcp:105: 00010000:00010000:1.0:1787393173.690498:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393173.690574:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de826cff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2356:x1874217319579264:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 2776us (3117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393173.690584:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:0.0:1787393173.694548:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393173.694633:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319579520 00000100:00100000:2.0:1787393173.694643:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319579520 00000100:00100000:2.0:1787393173.694699:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:2.0:1787393173.694709:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+33:10479:x1874217319579520:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:2.0:1787393173.695373:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+34:10479:x1874217319579520:12345-192.168.203.21@tcp:35:bash.0 Request processed in 662us (830us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787393173.695383:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:1.0:1787393173.864161:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787393173.868555:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8180aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338469248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787393173.868632:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393173.870609:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338469248 00000100:00100000:0.0:1787393173.870637:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338469248 00000100:00100000:0.0:1787393173.870705:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787393173.870713:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338469248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787393173.870736:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393173.870808:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338469248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (2176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393173.870815:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787393173.870926:0:3325:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1787393173.870932:0:3325:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:2.0:1787393173.870961:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8180aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338469248:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787393173.871827:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787393173.910686:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393173.911682:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319579648 00000100:00100000:2.0:1787393173.911695:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319579648 00000100:00100000:3.0:1787393173.911945:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 97 00000100:00100000:3.0:1787393173.911959:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+34:10495:x1874217319579648:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1787393173.911982:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393173.912008:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1a81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d792 expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.912087:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1a88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.912099:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1a88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.912113:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1a88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393173.912168:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787393173.912172:0:10433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787393173.912192:0:10433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1a88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.912216:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1a81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d792 expref: 36 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.912234:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1a88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d792 expref: 35 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.912243:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:3.0:1787393173.912258:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787393173.912262:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530200, rc 0) 00000100:00100000:3.0:1787393173.912361:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+35:10495:x1874217319579648:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 406us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393173.912369:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 97 00000100:00100000:0.0:1787393173.919539:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393173.919691:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319579904 00000100:00100000:3.0:1787393173.919701:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319579904 00000100:00100000:3.0:1787393173.919760:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 98 00000100:00100000:3.0:1787393173.919771:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+35:10495:x1874217319579904:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1787393173.919792:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393173.919821:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1a8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d799 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.919946:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1a96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.919961:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.919972:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393173.919984:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787393173.920117:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1a8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d799 expref: 38 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.920135:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1a96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d799 expref: 37 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.920162:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54600) 00010000:00010000:3.0:1787393173.920165:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787393173.920168:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530600, rc 0) 00000100:00100000:3.0:1787393173.920320:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+37:10495:x1874217319579904:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 551us (790us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787393173.920327:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 98 00000100:00100000:0.0:1787393173.929407:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393173.929515:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319580032 00000100:00100000:3.0:1787393173.929526:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319580032 00000100:00100000:3.0:1787393173.929593:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:3.0:1787393173.929603:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+37:2356:x1874217319580032:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787393173.929628:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393173.929652:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1a96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d799 expref: 37 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.929674:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54600) 00010000:00010000:3.0:1787393173.929679:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393173.929731:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+36:2356:x1874217319580032:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 129us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393173.929737:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:0.0:1787393173.930297:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393173.930494:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319580288 00000100:00100000:3.0:1787393173.930500:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319580288 00000100:00100000:3.0:1787393173.930548:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 99 00000100:00100000:3.0:1787393173.930556:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+36:10495:x1874217319580288:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1787393173.930579:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393173.930597:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1aa4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d7a0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.930705:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1aab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.930719:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1aab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.930729:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1aab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393173.930742:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787393173.930894:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1aa4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7a0 expref: 39 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.930921:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1aab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7a0 expref: 38 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.930928:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54600) 00010000:00010000:3.0:1787393173.930932:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787393173.930935:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531800, rc 0) 00000100:00100000:3.0:1787393173.930971:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+38:10495:x1874217319580288:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 415us (675us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787393173.930977:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 99 00000100:00100000:0.0:1787393173.937714:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393173.937830:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319580416 00000100:00100000:1.0:1787393173.937969:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319580416 00000100:00100000:1.0:1787393173.938024:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:1.0:1787393173.938045:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319580416:12345-192.168.203.21@tcp:1:lfs.0 00010000:00010000:1.0:1787393173.938090:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1ab9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.938112:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1a7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d78b expref: 6 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.938120:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787393173.938123:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787393173.938128:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1ab9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.938226:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1a7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d78b expref: 6 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.938259:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1a7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d78b expref: 6 pid: 7525 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393173.938273:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6624:1874217338469376:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393173.938398:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787393173.941464:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393173.941574:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6624:1874217338469376:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393173.941599:0:6624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1ab9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393173.941666:0:6628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319580544 00000100:00100000:2.0:1787393173.941674:0:6628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319580544 00002000:00100000:2.0:1787393173.941719:0:6628:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9de8089f3480 x1874217319580544/t0(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:144/0 lens 504/0 e 0 to 0 dl 1787393184 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787393173.941728:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de8089f3480 with x1874217319580544 ext(0->8) 00010000:00010000:2.0:1787393173.941735:0:6628:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1a7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d78b expref: 7 pid: 7525 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.941767:0:6628:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1a7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d78b expref: 7 pid: 7525 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787393173.941775:0:6628:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9de8089f3480 00000100:00100000:2.0:1787393173.941808:0:6628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:2.0:1787393173.941829:0:6628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2355:x1874217319580544:12345-192.168.203.21@tcp:4:lfs.0 00000100:00100000:2.0:1787393173.942366:0:6628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:2355:x1874217319580544:12345-192.168.203.21@tcp:4:lfs.0 Request processed in 538us (909us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787393173.942374:0:6628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 1 00002000:00100000:2.0:1787393173.942381:0:6628:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9de8089f3480 x1874217319580544/t4294967302(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:144/0 lens 504/448 e 0 to 0 dl 1787393184 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787393173.942389:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de8089f3480 with x1874217319580544 ext(0->8) 00010000:00010000:2.0:1787393173.942395:0:6628:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1a7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d78b expref: 9 pid: 7525 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.942408:0:6628:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1a7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d78b expref: 9 pid: 7525 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787393173.942416:0:6628:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9de8089f3480 00000100:00100000:0.0:1787393173.945795:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393173.946796:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319580672 00000100:00100000:2.0:1787393173.946808:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319580672 00010000:00010000:2.0:1787393173.946884:0:11945:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1a7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d78b expref: 9 pid: 7525 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393173.947006:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:2.0:1787393173.947017:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:2356:x1874217319580672:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393173.947044:0:11945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787393173.947069:0:11945:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787393173.947072:0:11945:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787393174 00002000:00010000:2.0:1787393173.947074:0:11945:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787393174 00002000:00010000:2.0:1787393173.947077:0:11945:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787393174 00010000:00010000:2.0:1787393173.947083:0:11945:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1a7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d78b expref: 9 pid: 7525 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.947101:0:11945:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1a7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d78b expref: 9 pid: 7525 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.947128:0:11945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1a7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d78b expref: 9 pid: 7525 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.947143:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787393173.947147:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787393173.947152:0:11945:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1ab9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.947162:0:11945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1ab9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.947200:0:11945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393173.948407:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2356:x1874217319580672:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 1386us (2613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393173.948418:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 50 00010000:00010000:0.0:1787393173.948587:0:6624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1ab9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.948599:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1ab9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.948640:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1ab9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.948648:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1ab9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.948656:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1ab9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.948673:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a400 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393173.948678:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1ab9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.948686:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1ab9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.948702:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1ab9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.948710:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1c86c28/0x19a927d9c62f1ab9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393173.948760:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2355:x1874217319580416:12345-192.168.203.21@tcp:1:lfs.0 Request processed in 10716us (11055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393173.948767:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:0.0:1787393173.951646:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393173.951738:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319580928 00000100:00100000:3.0:1787393173.951747:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319580928 00000100:00100000:3.0:1787393173.951806:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 26 00000100:00100000:3.0:1787393173.951815:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818e6b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+38:10495:x1874217319580928:12345-192.168.203.21@tcp:35:lfs.0 00000004:00010000:3.0:1787393173.951891:0:5823:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1aab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7a0 expref: 38 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787393173.952201:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1787393173.952462:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1787393173.952769:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1787393173.952823:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1ac0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.952862:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1a65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d77d expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.952873:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1ac0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.953712:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1a65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d77d expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.953730:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1a65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d77d expref: 42 pid: 5822 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393173.953746:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8180ab480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5823:1874217338469504:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393173.953923:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80fcb4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787393173.957183:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393173.957320:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8180ab480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5823:1874217338469504:192.168.203.21@tcp:104: 00000100:00100000:2.0:1787393173.957325:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319581056 00000100:00100000:2.0:1787393173.957335:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319581056 00010000:00010000:3.0:1787393173.957346:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1ac0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.957371:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1a65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d77d expref: 43 pid: 5822 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393173.957467:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:2.0:1787393173.957479:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+43:2355:x1874217319581056:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393173.957493:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393173.957500:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1a65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d77d expref: 43 pid: 5822 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.957513:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1a65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d77d expref: 43 pid: 5822 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.957536:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1a65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d77d expref: 43 pid: 5822 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.957551:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54600) 00010000:00010000:2.0:1787393173.957557:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1ac0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.957566:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1ac0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.957574:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1ac0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393173.957625:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393173.957682:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+42:2355:x1874217319581056:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 204us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393173.957690:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 51 00010000:00010000:3.0:1787393173.957716:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1ac0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393173.957729:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1ac0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787393173.957892:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1787393173.958101:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1787393173.958203:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8180ab480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1874217338469632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787393173.958246:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393173.958277:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818104e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787393173.958322:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338469632 00000100:00100000:2.0:1787393173.958329:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338469632 00000100:00100000:2.0:1787393173.958385:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787393173.958447:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5823:x1874217338469632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787393173.958527:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5823:x1874217338469632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 134us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393173.958534:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787393173.958598:0:5823:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1787393173.958605:0:5823:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1787393173.958628:0:5823:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9de83c63e300, transno 4294967301 00000100:00100000:0.0:1787393173.958646:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8180ab480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1874217338469632:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787393173.959627:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1787393173.959689:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8089f1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1874217338469760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787393173.959736:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393173.959768:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80fcb4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787393173.959796:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338469760 00000100:00100000:3.0:1787393173.959802:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338469760 00000100:00100000:3.0:1787393173.959863:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787393173.959871:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5823:x1874217338469760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787393173.960105:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5823:x1874217338469760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 232us (365us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787393173.960113:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787393173.960126:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8089f1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1874217338469760:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787393173.960185:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1787393173.960218:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1ac0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.960406:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1ac0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.960413:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1ac0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.960418:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393173.960423:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1ac0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.960430:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1ac0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.960445:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54600) 00010000:00010000:0.0:1787393173.960448:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787393173.960452:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1ac0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393173.960458:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1ac0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787393173.960603:0:5823:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00080000:1.0:1787393173.961425:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1787393173.961547:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1787393173.961557:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323136717908ns, next at 324136716005ns, rc = 0 00000001:00080000:0.0:1787393173.961573:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1787393173.961725:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54600) 00010000:00010000:0.0:1787393173.961730:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787393173.961737:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1aab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7a0 expref: 46 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393173.962162:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818e6b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+45:10495:x1874217319580928:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 10347us (10524us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1787393173.962172:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 26 00000020:00080000:0.0:1787393173.962176:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787393173.965287:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393173.965363:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319581184 00000100:00100000:1.0:1787393173.965373:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319581184 00000100:00100000:1.0:1787393173.965480:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 100 00000100:00100000:1.0:1787393173.965491:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+45:10495:x1874217319581184:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393173.965516:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393173.965539:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1ac7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d7a7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.965598:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7a7 expref: 46 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.965613:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7a7 expref: 46 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393173.965654:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:1.0:1787393173.965658:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787393173.965662:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385b600, rc 0) 00000100:00100000:1.0:1787393173.965720:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+46:10495:x1874217319581184:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 231us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393173.965727:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 100 00000100:00100000:2.0:1787393173.970630:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393173.970772:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319581440 00000100:00100000:0.0:1787393173.970782:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319581440 00000100:00100000:0.0:1787393173.970959:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:0.0:1787393173.970971:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+46:10495:x1874217319581440:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:0.0:1787393173.971202:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+47:10495:x1874217319581440:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 232us (579us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1787393173.971209:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 27 00010000:00010000:2.0:1787393173.993738:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393174.075572:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393174.075671:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319581568 00000100:00100000:3.0:1787393174.075681:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319581568 00000100:00100000:3.0:1787393174.075747:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 101 00000100:00100000:3.0:1787393174.075757:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+47:10505:x1874217319581568:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:3.0:1787393174.075865:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1ace lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.075882:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1ace lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.075893:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1ace lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.075907:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ad5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.075932:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.075938:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076040:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1adc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076049:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076056:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787393174.076097:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076108:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1ace lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076114:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1ace lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076121:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1ace lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076127:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393174.076131:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1ace lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076139:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1ace lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076168:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:3.0:1787393174.076172:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393174.076177:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1ace lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076183:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1ace lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076198:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076204:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ad5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076209:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076214:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393174.076217:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076222:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ad5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076230:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de8063da500) 00010000:00010000:3.0:1787393174.076232:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393174.076235:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ad5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076240:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ad5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076265:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076271:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1adc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076276:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1adc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076281:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393174.076284:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1adc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076290:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1adc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076297:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:3.0:1787393174.076299:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393174.076302:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1adc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.076307:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1adc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393174.076380:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+47:10505:x1874217319581568:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 624us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393174.076389:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 101 00000100:00100000:1.0:1787393174.110989:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393174.111096:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319581824 00000100:00100000:3.0:1787393174.111109:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319581824 00000100:00100000:3.0:1787393174.111192:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 102 00000100:00100000:3.0:1787393174.111223:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+47:10508:x1874217319581824:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1787393174.111250:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393174.111277:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1ae3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d7ae expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111384:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1aea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111403:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1aea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111418:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1aea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111434:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1af1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111442:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111448:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111621:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1af8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111632:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111640:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393174.111667:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787393174.111785:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1aea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111794:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1aea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111800:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1aea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111806:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393174.111811:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1aea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111820:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1aea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111833:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:3.0:1787393174.111885:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393174.111891:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1aea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111898:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1aea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111916:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111923:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1af1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111943:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111949:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393174.111952:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111960:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1af1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111969:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de8063da500) 00010000:00010000:3.0:1787393174.111972:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393174.111974:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1af1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.111979:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1af1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.115112:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f1ae3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ae expref: 50 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.115147:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1af8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ae expref: 49 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.115157:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:2.0:1787393174.115160:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787393174.115163:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531c00, rc 0) 00000100:00100000:2.0:1787393174.115245:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+49:10508:x1874217319581824:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 4024us (4271us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787393174.115255:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 102 00000100:00100000:2.0:1787393174.119054:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393174.119207:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319581952 00000100:00100000:3.0:1787393174.119219:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319581952 00000100:00100000:3.0:1787393174.119291:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 103 00000100:00100000:3.0:1787393174.119302:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+49:10508:x1874217319581952:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:3.0:1787393174.119395:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1b06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.119418:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.119433:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.119478:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.119486:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1b06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.119494:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1b06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.119502:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393174.119507:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1b06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.119516:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1b06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.119530:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:3.0:1787393174.119534:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787393174.119540:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1b06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.119547:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1b06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393174.119651:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+49:10508:x1874217319581952:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 350us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393174.119659:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 103 00000100:00100000:0.0:1787393174.123146:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393174.123298:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319582208 00000100:00100000:2.0:1787393174.123322:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319582208 00000100:00100000:2.0:1787393174.123388:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:2.0:1787393174.123399:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+49:10508:x1874217319582208:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1787393174.123701:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+50:10508:x1874217319582208:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 302us (568us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787393174.123710:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:0.0:1787393174.183232:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393174.183490:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319582464 00000100:00100000:1.0:1787393174.183503:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319582464 00000100:00100000:1.0:1787393174.183579:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 104 00000100:00100000:1.0:1787393174.183591:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+50:10518:x1874217319582464:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:1.0:1787393174.183622:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393174.183627:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787393174.183660:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1a88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d792 expref: 50 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.183686:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:1.0:1787393174.183692:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787393174.183711:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1b0d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d7b5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.184014:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.184040:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1af8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ae expref: 50 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.184073:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b14 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.184116:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1af8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ae expref: 50 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.184131:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1af8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ae expref: 50 pid: 5820 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393174.184147:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1874217338469888:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393174.184278:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501f480 going to sleep for 11 seconds 00000100:00100000:3.0:1787393174.190482:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393174.190608:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1874217338469888:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393174.190643:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393174.191334:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319582592 00000100:00100000:0.0:1787393174.191345:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319582592 00010000:00010000:0.0:1787393174.191398:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1af8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ae expref: 51 pid: 5820 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393174.191433:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00100000:0.0:1787393174.191444:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+51:2356:x1874217319582592:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787393174.191480:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393174.191489:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1af8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ae expref: 51 pid: 5820 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.191503:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1af8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ae expref: 51 pid: 5820 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.191530:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1af8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ae expref: 51 pid: 5820 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.191551:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:0.0:1787393174.191556:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.191568:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.191576:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b14 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.191612:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393174.191689:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+50:2356:x1874217319582592:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 246us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393174.191698:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 52 00010000:00010000:1.0:1787393174.191810:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.191828:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393174.191879:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787393174.192106:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1b0d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7b5 expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.192123:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7b5 expref: 50 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.192145:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:1.0:1787393174.192148:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787393174.192151:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385a800, rc 0) 00000100:00100000:1.0:1787393174.192199:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+50:10518:x1874217319582464:12345-192.168.203.21@tcp:101:bash.0 Request processed in 8611us (8983us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1787393174.192207:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 104 00000100:00100000:0.0:1787393174.195587:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393174.195737:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319582848 00000100:00100000:3.0:1787393174.195751:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319582848 00000100:00100000:3.0:1787393174.195827:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 105 00000100:00100000:3.0:1787393174.195864:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+50:10518:x1874217319582848:12345-192.168.203.21@tcp:36:bash.0 00010000:00010000:3.0:1787393174.196270:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1b22 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.196292:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1b22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.196306:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1b22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787393174.196383:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1787393174.196413:0:5821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000127bf6b4 reply state 000000009b4d0f70 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1b22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393174.196425:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787393174.196544:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+53:10518:x1874217319582848:12345-192.168.203.21@tcp:36:bash.0 Request processed in 706us (971us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1787393174.196553:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 105 00000020:00080000:3.0:1787393174.196559:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787393174.199653:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00010000:00010000:0.0:1787393174.199983:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1b22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.199998:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1b22 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.200036:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1b22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.200044:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393174.200049:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1b22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.200059:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1b22 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.200079:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:0.0:1787393174.200082:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393174.200088:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1b22 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.200095:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1b22 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393174.200761:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319582976 00000100:00100000:2.0:1787393174.200774:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319582976 00000100:00100000:2.0:1787393174.201078:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 106 00000100:00100000:2.0:1787393174.201091:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+52:10518:x1874217319582976:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1787393174.201121:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393174.201144:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1b29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d7bc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.201253:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1b30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.201269:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b14 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7b5 expref: 53 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.201278:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1b30 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.201329:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7b5 expref: 53 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.201345:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7b5 expref: 53 pid: 5822 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393174.201374:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5af800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1874217338470016:192.168.203.21@tcp:104: 00000100:00100000:2.0:1787393174.201518:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de701b716c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787393174.204939:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393174.205023:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319583104 00000100:00100000:3.0:1787393174.205043:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319583104 00010000:00010000:3.0:1787393174.205093:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b14 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7b5 expref: 54 pid: 5822 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393174.205142:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 53 00000100:00100000:3.0:1787393174.205163:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:2356:x1874217319583104:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787393174.205183:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393174.205209:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b14 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7b5 expref: 54 pid: 5822 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.205225:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7b5 expref: 54 pid: 5822 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.205254:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:3.0:1787393174.205260:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1b30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.205272:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.205280:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1b30 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.205306:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393174.205381:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:2356:x1874217319583104:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 229us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393174.205390:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 53 00010000:00010000:1.0:1787393174.206601:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7b5 expref: 53 pid: 5822 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393174.206629:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5af800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1874217338470016:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393174.206660:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.206671:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.206677:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393174.206736:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787393174.206742:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393174.206769:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.206812:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1b29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7bc expref: 53 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.206830:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1b30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7bc expref: 52 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.206974:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:1.0:1787393174.206977:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393174.206981:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5200, rc 0) 00000100:00100000:1.0:1787393174.207090:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+52:10518:x1874217319582976:12345-192.168.203.21@tcp:101:bash.0 Request processed in 6001us (7450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393174.207099:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 106 00000100:00100000:2.0:1787393174.210170:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393174.210252:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319583360 00000100:00100000:0.0:1787393174.210264:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319583360 00000100:00100000:0.0:1787393174.210331:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:0.0:1787393174.210342:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+52:10518:x1874217319583360:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:0.0:1787393174.210650:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+53:10518:x1874217319583360:12345-192.168.203.21@tcp:35:bash.0 Request processed in 309us (501us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1787393174.210660:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:0.0:1787393174.271557:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393174.271729:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319583488 00000100:00100000:3.0:1787393174.271743:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319583488 00000100:00100000:3.0:1787393174.271809:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 107 00000100:00100000:3.0:1787393174.271820:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+53:10524:x1874217319583488:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1787393174.271885:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393174.271917:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1b37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d7c3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.271995:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1b3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.272036:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.272050:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393174.272129:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787393174.272133:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787393174.272614:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.272650:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1b37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7c3 expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.272672:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1b3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7c3 expref: 54 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.272681:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:2.0:1787393174.272684:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787393174.272688:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530400, rc 0) 00000100:00100000:2.0:1787393174.272770:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:10524:x1874217319583488:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 952us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393174.272778:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 107 00000100:00100000:3.0:1787393174.277112:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393174.277240:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319583616 00000100:00100000:1.0:1787393174.277253:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319583616 00000100:00100000:1.0:1787393174.277347:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 108 00000100:00100000:1.0:1787393174.277360:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:10524:x1874217319583616:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393174.277391:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393174.277417:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d7ca expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277506:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1b4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277525:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1b4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277539:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1b4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277558:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277566:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277595:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277714:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1b5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277722:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1b5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277730:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1b5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393174.277773:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787393174.277778:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393174.277798:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1b5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277812:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1b5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277820:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1b4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277827:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1b4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277835:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1b4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277892:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385ae00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393174.277897:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1b4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277912:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1b4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277927:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:1.0:1787393174.277930:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393174.277934:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1b4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277941:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1b4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277955:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277961:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277966:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277972:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393174.277974:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277979:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.277985:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de81aa54000) 00010000:00010000:1.0:1787393174.277987:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393174.277990:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.278003:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.278048:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ca expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.278062:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1b5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ca expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.278070:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:1.0:1787393174.278073:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393174.278076:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385aa00, rc 0) 00000100:00100000:1.0:1787393174.278145:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:10524:x1874217319583616:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 788us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393174.278153:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 108 00000100:00100000:3.0:1787393174.282714:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393174.282773:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393174.282882:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319583744 00000100:00100000:0.0:1787393174.282896:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319583744 00000100:00100000:0.0:1787393174.282988:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:0.0:1787393174.283019:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:2354:x1874217319583744:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787393174.283048:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393174.283079:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1b5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ca expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.283103:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:0.0:1787393174.283108:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393174.283186:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:2354:x1874217319583744:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 169us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393174.283194:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:1.0:1787393174.285608:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319584000 00000100:00100000:1.0:1787393174.285623:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319584000 00000100:00100000:1.0:1787393174.285700:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 109 00000100:00100000:1.0:1787393174.285711:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:10524:x1874217319584000:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393174.285732:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393174.285756:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1b61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d7d1 expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.285898:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1b68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.285914:0:10433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1b30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7bc expref: 55 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.285938:0:10433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1b68 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.285974:0:10433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1b30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7bc expref: 55 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.285988:0:10433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1b30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7bc expref: 55 pid: 5820 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393174.286002:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338470144:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393174.286102:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501f480 going to sleep for 11 seconds 00000100:00100000:3.0:1787393174.291536:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393174.291610:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319584128 00000100:00100000:0.0:1787393174.291624:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319584128 00010000:00010000:0.0:1787393174.291674:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1b30 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7bc expref: 56 pid: 5820 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393174.291723:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 54 00000100:00100000:0.0:1787393174.291734:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de826cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+56:2355:x1874217319584128:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787393174.291754:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393174.291762:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1b30 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7bc expref: 56 pid: 5820 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.291778:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1b30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7bc expref: 56 pid: 5820 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.291806:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:0.0:1787393174.291813:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1b68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.291874:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1b68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.291885:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1b68 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.291983:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393174.292060:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de826cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+56:2355:x1874217319584128:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 326us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393174.292070:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 54 00010000:00010000:1.0:1787393174.292100:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f1b30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7bc expref: 55 pid: 5820 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393174.292132:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338470144:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393174.292158:0:10433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1b68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.292167:0:10433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1b68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.292173:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1b68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393174.292195:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787393174.292369:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1b61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7d1 expref: 56 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.292401:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1b68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7d1 expref: 55 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.292409:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:1.0:1787393174.292412:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787393174.292415:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385ac00, rc 0) 00000100:00100000:1.0:1787393174.292477:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:10524:x1874217319584000:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 6767us (9702us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787393174.292485:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 109 00000100:00100000:0.0:1787393174.296520:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393174.296993:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319584384 00000100:00100000:1.0:1787393174.297011:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319584384 00000100:00100000:1.0:1787393174.297106:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:1.0:1787393174.297116:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:10524:x1874217319584384:12345-192.168.203.21@tcp:103:lfs.0 00010000:00010000:1.0:1787393174.297132:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393174.297156:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1ac7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7a7 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.297174:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:1.0:1787393174.297178:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393174.297253:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:10524:x1874217319584384:12345-192.168.203.21@tcp:103:lfs.0 Request processed in 139us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393174.297261:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:3.0:1787393174.302602:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393174.303326:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319584512 00000100:00100000:1.0:1787393174.303342:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319584512 00000100:00100000:1.0:1787393174.303426:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 110 00000100:00100000:1.0:1787393174.303456:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:10524:x1874217319584512:12345-192.168.203.21@tcp:58:lfs.0 00010000:00010000:1.0:1787393174.303614:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1b76 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.303636:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1b76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.303649:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1b76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787393174.303948:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1787393174.304068:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:10524:x1874217319584512:12345-192.168.203.21@tcp:58:lfs.0 Request processed in 613us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393174.304078:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 110 00000100:00100000:3.0:1787393174.309721:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393174.309858:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319584640 00000100:00100000:2.0:1787393174.309873:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319584640 00000100:00100000:2.0:1787393174.309956:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 111 00000100:00100000:2.0:1787393174.309969:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:10524:x1874217319584640:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1787393174.309995:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393174.310021:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1b7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d7d8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.310138:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1b76 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.310151:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1b7d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7d8 expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.310176:0:5821:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1b76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.310192:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1b7d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7d8 expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.310209:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:2.0:1787393174.310213:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787393174.310218:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1b7d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7d8 expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.310227:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4c00, rc 0) 00000100:00100000:2.0:1787393174.310485:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:10524:x1874217319584640:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 517us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393174.310494:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 111 00000040:00080000:0.0:1787393174.312966:0:11566:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787393174.312976:0:11566:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787393174.313014:0:11566:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787393174.313021:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787393174.313153:0:11566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834b44380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11566:1874217338470272:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787393174.313238:0:11566:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de82d0f5480 going to sleep for 11 seconds 00000100:00100000:0.0:1787393174.316093:0:11566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834b44380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11566:1874217338470272:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787393174.316389:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393174.316487:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319584768 00000100:00100000:1.0:1787393174.316498:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319584768 00000100:00100000:1.0:1787393174.316577:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 112 00000100:00100000:1.0:1787393174.316589:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:10525:x1874217319584768:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787393174.316631:0:5822:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787393174.316759:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:10525:x1874217319584768:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 172us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393174.316768:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 112 00000100:00100000:3.0:1787393174.326410:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393174.326643:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319584896 00000100:00100000:1.0:1787393174.326657:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319584896 00000100:00100000:1.0:1787393174.326901:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 113 00000100:00100000:1.0:1787393174.326914:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:10525:x1874217319584896:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787393174.327016:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1b84 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.327615:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1b84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.327630:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1b84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.327652:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b8b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.327659:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.327665:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.327696:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.327711:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.327718:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393174.327866:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787393174.327871:0:10433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393174.327887:0:10433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.327899:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1b84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.327917:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1b84 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.327924:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1b84 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.327930:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385b600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393174.327935:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1b84 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.327943:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1b84 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.327957:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9de8184fc100) 00010000:00010000:1.0:1787393174.328037:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393174.328043:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1b84 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.328050:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1b84 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.328069:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.328075:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b8b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.328305:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b8b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.328311:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393174.328321:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b8b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.328399:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b8b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.328412:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9de81aa54000) 00010000:00010000:1.0:1787393174.328415:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393174.328418:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b8b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.328424:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1b8b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.328444:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.328450:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.328457:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.328462:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393174.328465:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.328470:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.328478:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:1.0:1787393174.328481:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393174.328568:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.328577:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393174.328960:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:10525:x1874217319584896:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 Request processed in 2042us (2558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393174.328973:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 113 00000100:00100000:0.0:1787393174.336147:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393174.337007:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319585152 00000100:00100000:1.0:1787393174.337023:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319585152 00000100:00100000:1.0:1787393174.337122:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 114 00000100:00100000:1.0:1787393174.337134:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:10525:x1874217319585152:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787393174.337169:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393174.337586:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b99 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d7df expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.338085:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1ba0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.338105:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.338119:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393174.338137:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787393174.338679:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.338690:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1ba0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.338715:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.338722:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393174.339023:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.339046:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.339065:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:1.0:1787393174.339069:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787393174.339074:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1ba0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.339081:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1ba0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.339163:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b99 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7df expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.339175:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9de8184fc100) 00010000:00010000:1.0:1787393174.339178:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787393174.339183:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1b99 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7df expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.339194:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385a400, rc 0) 00000100:00100000:1.0:1787393174.339394:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+56:10525:x1874217319585152:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 2196us (3197us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1787393174.339417:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 114 00000100:00100000:3.0:1787393174.349938:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393174.350043:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319585280 00000100:00100000:2.0:1787393174.350057:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319585280 00000100:00100000:2.0:1787393174.350139:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 115 00000100:00100000:2.0:1787393174.350152:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+56:10525:x1874217319585280:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787393174.350197:0:5821:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787393174.350632:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+56:10525:x1874217319585280:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 481us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393174.350642:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 115 00000100:00100000:3.0:1787393174.353335:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393174.353471:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319585536 00000100:00100000:2.0:1787393174.353486:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319585536 00000100:00100000:2.0:1787393174.353573:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 116 00000100:00100000:2.0:1787393174.353584:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+56:10525:x1874217319585536:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787393174.353612:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393174.353617:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787393174.353652:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1b3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7c3 expref: 56 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.353679:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:2.0:1787393174.353685:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787393174.353714:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1bae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d7e6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787393174.355102:0:5820:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787393174.361201:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f1bb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.361226:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f1bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.361240:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f1bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.361343:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1bae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7e6 expref: 58 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.361383:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f1bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7e6 expref: 57 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.361393:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9de818bd8600) 00010000:00010000:2.0:1787393174.361396:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787393174.361399:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5e00, rc 0) 00000100:00100000:2.0:1787393174.361524:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+57:10525:x1874217319585536:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 7941us (8202us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787393174.361533:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 116 00000100:00100000:0.0:1787393174.368056:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393174.369707:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319585792 00000100:00100000:1.0:1787393174.369730:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319585792 00000100:00100000:1.0:1787393174.369935:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 117 00000100:00100000:1.0:1787393174.369948:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+57:10525:x1874217319585792:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787393174.370040:0:10433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393174.370075:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f1bb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7e6 expref: 57 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.370116:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9de818bd8600) 00010000:00010000:1.0:1787393174.370131:0:10433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787393174.370161:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1bc3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.370178:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1bc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.370189:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1bc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.372423:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5b50fb32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.372445:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5b50fb32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.372457:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5b50fb32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.372559:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1bc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.372567:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1bc3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.372573:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1bc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.372580:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393174.372584:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1bc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.372590:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1bc3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.372604:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:1.0:1787393174.372606:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393174.372610:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1bc3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.372616:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1bc3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.372628:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5b50fb32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.372634:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5b50fb32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.372640:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5b50fb32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.372654:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393174.372657:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5b50fb32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.372663:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5b50fb32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.372670:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5b50fb32 (ffff9de81aa54000) 00010000:00010000:1.0:1787393174.372673:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393174.372676:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5b50fb32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.372682:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5b50fb32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393174.373977:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+56:10525:x1874217319585792:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 4023us (5925us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787393174.373990:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 117 00000100:00100000:1.0:1787393174.376064:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338470656:0@lo:400:kworker.0 00000100:00100000:2.0:1787393174.376295:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338470400:0@lo:400:kworker.0 00000100:00100000:2.0:1787393174.376379:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393174.376438:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393174.376463:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787393174.376472:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338470784:0@lo:400:kworker.0 00000100:00100000:2.0:1787393174.376518:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338470400 00000100:00100000:2.0:1787393174.376528:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338470400 00000100:00100000:1.0:1787393174.376584:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787393174.376593:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787393174.376599:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338470528:0@lo:400:kworker.0 00000100:00100000:2.0:1787393174.376611:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338470400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393174.377197:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338470656 00000100:00100000:0.0:1787393174.377208:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338470656 00000100:00100000:0.0:1787393174.377280:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787393174.377290:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338470656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393174.377427:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338470400:12345-0@lo:400:kworker.0 Request processed in 818us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393174.377438:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787393174.377491:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393174.377544:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338470400:0@lo:400:kworker.0 00000100:00100000:2.0:1787393174.377577:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338470784 00000100:00100000:2.0:1787393174.377582:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338470784 00000100:00100000:2.0:1787393174.377633:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787393174.377639:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338470784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393174.377682:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338470784:12345-0@lo:400:kworker.0 Request processed in 43us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393174.377688:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787393174.377715:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338470784:0@lo:400:kworker.0 00000100:00080000:3.0:1787393174.378050:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393174.378569:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393174.378618:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338470528 00000100:00100000:1.0:1787393174.378625:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338470528 00000100:00100000:0.0:1787393174.378763:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338470656:12345-0@lo:400:kworker.0 Request processed in 1473us (2329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393174.378777:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787393174.378822:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787393174.378830:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338470528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393174.378884:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338470528:12345-0@lo:400:kworker.0 Request processed in 55us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393174.378890:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787393174.378963:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338470528:0@lo:400:kworker.0 00000100:00100000:1.0:1787393174.378976:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338470656:0@lo:400:kworker.0 00000100:00100000:0.0:1787393174.379591:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393174.379690:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319585920 00000100:00100000:3.0:1787393174.379696:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319585920 00000100:00100000:3.0:1787393174.379765:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 118 00000100:00100000:3.0:1787393174.379774:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+56:10525:x1874217319585920:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787393174.379832:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393174.379879:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1bd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d7ed expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.379915:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1bd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.379937:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.379950:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.380055:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1bd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ed expref: 58 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.380074:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ed expref: 57 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.380083:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9de8063da500) 00010000:00010000:3.0:1787393174.380086:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787393174.380090:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530600, rc 0) 00000100:00100000:3.0:1787393174.380139:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+57:10525:x1874217319585920:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 366us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393174.380146:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 118 00000100:00100000:3.0:1787393174.383317:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393174.383399:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319586176 00000100:00100000:1.0:1787393174.383409:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319586176 00000100:00100000:1.0:1787393174.383461:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 119 00000100:00100000:1.0:1787393174.383471:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+57:10525:x1874217319586176:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787393174.383547:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bdf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.383564:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.383574:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787393174.383924:0:10433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:1.0:1787393174.384046:0:10433:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007c19d28c reply state 0000000041aed4bd transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393174.384056:0:10433:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787393174.384156:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+59:10525:x1874217319586176:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 685us (848us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1787393174.384164:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 119 00010000:00010000:0.0:1787393174.386197:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.386212:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bdf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.386219:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.386224:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393174.386230:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.386242:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bdf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.386257:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9de8063da500) 00010000:00010000:0.0:1787393174.386260:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787393174.386266:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bdf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.386272:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1bdf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393174.391719:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393174.392479:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319586304 00000100:00100000:0.0:1787393174.392503:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319586304 00000100:00100000:0.0:1787393174.392569:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 120 00000100:00100000:0.0:1787393174.392578:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+58:10525:x1874217319586304:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787393174.392602:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393174.392621:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1be6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d7f4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.392678:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1be6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7f4 expref: 59 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.392693:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1be6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7f4 expref: 59 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.392712:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9de8063da500) 00010000:00010000:0.0:1787393174.392715:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787393174.392718:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761de00, rc 0) 00000100:00100000:0.0:1787393174.392836:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+59:10525:x1874217319586304:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 258us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393174.392859:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 120 00000100:00100000:1.0:1787393174.397368:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393174.397593:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319586432 00000100:00100000:2.0:1787393174.397603:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319586432 00000100:00100000:2.0:1787393174.397707:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00100000:2.0:1787393174.397718:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2356:x1874217319586432:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787393174.398045:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:2356:x1874217319586432:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 328us (685us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787393174.398054:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00100000:2.0:1787393174.401671:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393174.405329:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319586688 00000100:00100000:0.0:1787393174.405345:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319586688 00000100:00100000:0.0:1787393174.405499:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:0.0:1787393174.405512:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+59:10525:x1874217319586688:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787393174.405765:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:10525:x1874217319586688:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 256us (4101us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787393174.405773:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:0.0:1787393174.410192:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393174.410327:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319586944 00000100:00100000:1.0:1787393174.410338:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319586944 00000100:00100000:1.0:1787393174.412226:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 121 00000100:00100000:1.0:1787393174.412247:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:10525:x1874217319586944:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787393174.412359:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:10525:x1874217319586944:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 121us (2175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393174.412382:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 121 00000100:00100000:1.0:1787393174.414499:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393174.416284:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319587072 00000100:00100000:3.0:1787393174.416297:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319587072 00000100:00100000:3.0:1787393174.417678:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 122 00000100:00100000:3.0:1787393174.417699:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:10525:x1874217319587072:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787393174.417720:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393174.417743:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1bed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d7fb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.417833:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1bf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.417863:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.417873:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393174.417911:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787393174.417927:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.417953:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1bed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7fb expref: 62 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.417972:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7fb expref: 61 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.417981:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9de8063da500) 00010000:00010000:3.0:1787393174.417983:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787393174.417987:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530200, rc 0) 00000100:00100000:3.0:1787393174.418061:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+61:10525:x1874217319587072:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 371us (3570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393174.418068:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 122 00000100:00100000:0.0:1787393174.420899:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393174.421012:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319587200 00000100:00100000:3.0:1787393174.421022:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319587200 00000100:00100000:3.0:1787393174.421091:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:3.0:1787393174.421114:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:2355:x1874217319587200:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787393174.421133:0:6622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393174.421165:0:6622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b6444ad/0x19a927d9c62f1bfb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d802 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787393174.421191:0:6622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a897496, blocks: 0x1 00010000:00010000:3.0:1787393174.421210:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1787393174.421214:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393174.421223:0:6622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b6444ad/0x19a927d9c62f1bfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d802 expref: 10 pid: 6622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.421237:0:6622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b6444ad/0x19a927d9c62f1bfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d802 expref: 10 pid: 6622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.421249:0:6622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531800, rc 0) 00000100:00100000:3.0:1787393174.421305:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:2355:x1874217319587200:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 193us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393174.421312:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:1.0:1787393174.427824:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393174.429527:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319587456 00000100:00100000:2.0:1787393174.429540:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319587456 00000100:00100000:2.0:1787393174.429607:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 123 00000100:00100000:2.0:1787393174.429616:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+61:10525:x1874217319587456:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787393174.429723:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+61:10525:x1874217319587456:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 108us (1908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393174.429731:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 123 00000100:00100000:1.0:1787393174.432510:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393174.432653:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319587584 00000100:00100000:3.0:1787393174.432663:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319587584 00000100:00100000:3.0:1787393174.432718:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 40 00000100:00100000:3.0:1787393174.432727:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:10525:x1874217319587584:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787393174.432745:0:7525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393174.432762:0:7525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1c02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d809 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.432809:0:7525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b6444ad/0x19a927d9c62f1bfb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d802 expref: 11 pid: 6622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.432818:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393174.432822:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393174.432826:0:7525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1c02 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d809 expref: 11 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.432892:0:7525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b6444ad/0x19a927d9c62f1bfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d802 expref: 11 pid: 6622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.432905:0:7525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b6444ad/0x19a927d9c62f1bfb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d802 expref: 11 pid: 6622 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393174.432919:0:7525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8180ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7525:1874217338470912:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393174.433003:0:7525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818104e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787393174.437798:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393174.438207:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319587712 00000100:00100000:1.0:1787393174.438221:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319587712 00010000:00010000:1.0:1787393174.438278:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b6444ad/0x19a927d9c62f1bfb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d802 expref: 12 pid: 6622 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393174.438337:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00100000:3.0:1787393174.438391:0:7525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8180ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7525:1874217338470912:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393174.438403:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+12:2356:x1874217319587712:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393174.438420:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393174.438427:0:7525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1c02 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d809 expref: 12 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.438447:0:7525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531c00, rc 0) 00000100:00100000:3.0:1787393174.438580:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+12:10525:x1874217319587584:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 5853us (6079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393174.438589:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 40 00010000:00010000:1.0:1787393174.446203:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b6444ad/0x19a927d9c62f1bfb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d802 expref: 11 pid: 6622 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.446237:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b6444ad/0x19a927d9c62f1bfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d802 expref: 11 pid: 6622 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.446273:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b6444ad/0x19a927d9c62f1bfb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d802 expref: 11 pid: 6622 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.446296:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393174.446301:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393174.446310:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1c02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d809 expref: 10 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.446363:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1c02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d809 expref: 10 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.446429:0:5805:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1c02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d809 expref: 10 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393174.446449:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5805:1874217338471040:192.168.203.21@tcp:105: 00000100:00100000:1.0:1787393174.446564:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787393174.451413:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5805:1874217338471040:192.168.203.21@tcp:105: 00010000:00010000:1.0:1787393174.451452:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393174.451520:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:2356:x1874217319587712:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 13118us (13737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393174.451533:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00100000:0.0:1787393174.453990:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393174.454414:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319587840 00000100:00100000:2.0:1787393174.454428:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319587840 00002000:00100000:2.0:1787393174.454496:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9de834b46300 x1874217319587840/t0(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:145/0 lens 504/0 e 0 to 0 dl 1787393185 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787393174.454534:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de834b46300 with x1874217319587840 ext(0->12) 00002000:00010000:2.0:1787393174.454543:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de834b46300 00000100:00100000:2.0:1787393174.454627:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:2.0:1787393174.454639:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:2356:x1874217319587840:12345-192.168.203.21@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787393174.459771:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+12:2356:x1874217319587840:12345-192.168.203.21@tcp:4:lhsmtool_posix.0 Request processed in 5117us (5775us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787393174.459790:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 3 00002000:00100000:2.0:1787393174.459807:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9de834b46300 x1874217319587840/t4294967309(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:145/0 lens 504/448 e 0 to 0 dl 1787393185 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787393174.459820:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de834b46300 with x1874217319587840 ext(0->12) 00002000:00010000:2.0:1787393174.459828:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de834b46300 00000100:00100000:0.0:1787393174.473315:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393174.473434:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319587968 00000100:00100000:1.0:1787393174.473447:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319587968 00000100:00100000:1.0:1787393174.473516:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 124 00000100:00100000:1.0:1787393174.473527:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+61:10525:x1874217319587968:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787393174.529301:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+61:10525:x1874217319587968:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 Request processed in 55766us (55991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393174.529313:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 124 00000001:00080000:3.0:1787393174.530152:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1787393174.530174:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787393174.530200:0:5842:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9de803ede900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1787393174.530204:0:5842:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9de818bc9c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9de803ede000 00000020:00080000:3.0:1787393174.530207:0:5842:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9de818bc9000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9de82d22e400 00000020:00080000:3.0:1787393174.530280:0:5842:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9de80b036000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787393174.530283:0:5842:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9de8418cf700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9de80b036180 00000020:00080000:3.0:1787393174.530286:0:5842:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9de8418cfb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9de83f599800 00000004:00080000:3.0:1787393174.530317:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:2.0:1787393174.531142:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787393174.531163:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338471168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787393174.531221:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393174.531294:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338471168 00000100:00100000:2.0:1787393174.531301:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338471168 00000100:00100000:2.0:1787393174.531345:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787393174.531353:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3324:x1874217338471168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787393174.531378:0:6622:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1787393174.531410:0:6622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a897496, atime: 0x6a897496, ctime: 0x6a897496, blocks: 0x1 00010000:00010000:2.0:1787393174.531433:0:6622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1c09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.531448:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=323s v=(0 0) 00010000:00010000:2.0:1787393174.531452:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787393174.531458:0:6622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1c09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.531472:0:6622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1c09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.531481:0:6622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1c09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.531489:0:6622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1c09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.531505:0:6622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787393174.532038:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3324:x1874217338471168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 673us (804us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787393174.532047:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1787393174.532082:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787393174.532089:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1c09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.532100:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4000 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393174.532107:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1c09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.532124:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1c09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.532142:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1c09 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.532150:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1c09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.532263:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393174.532270:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393174.532273:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787393174.532337:0:3324:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9de83f5f4700/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787393174.532349:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338471168:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1787393174.532406:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787393174.532538:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787393174.532774:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393174.532836:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319588096 00000100:00100000:3.0:1787393174.532869:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319588096 00000100:00100000:3.0:1787393174.532995:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:3.0:1787393174.533006:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+12:2353:x1874217319588096:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787393174.535479:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787393174.535503:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338471296:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787393174.535573:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393174.535639:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338471296 00000100:00100000:1.0:1787393174.535647:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338471296 00000100:00100000:1.0:1787393174.535695:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787393174.535705:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338471296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787393174.535744:0:6622:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1787393174.535769:0:6622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae0dc812/0x19a927d9c62f1c10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.535791:0:6622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fecd5b7/0x19a927d9c62f19cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d768 expref: 12 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.535801:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787393174.535806:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787393174.535811:0:6622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae0dc812/0x19a927d9c62f1c10 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.535885:0:6622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005fecd5b7/0x19a927d9c62f19cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d768 expref: 12 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.535902:0:6622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005fecd5b7/0x19a927d9c62f19cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d768 expref: 12 pid: 6622 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393174.535914:0:6622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6622:1874217338471424:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393174.535970:0:6622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787393174.541966:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393174.542642:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319588224 00000100:00100000:3.0:1787393174.542658:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319588224 00010000:00010000:3.0:1787393174.542712:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005fecd5b7/0x19a927d9c62f19cb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d768 expref: 13 pid: 6622 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393174.542768:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 56 00000100:00100000:3.0:1787393174.542780:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:2355:x1874217319588224:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787393174.542820:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393174.542827:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005fecd5b7/0x19a927d9c62f19cb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d768 expref: 13 pid: 6622 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.542872:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005fecd5b7/0x19a927d9c62f19cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d768 expref: 13 pid: 6622 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.543279:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787393174.543286:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787393174.543293:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae0dc812/0x19a927d9c62f1c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.543306:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae0dc812/0x19a927d9c62f1c10 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.543341:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393174.543419:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:2355:x1874217319588224:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 639us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393174.543427:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 56 00010000:00010000:1.0:1787393174.549641:0:6622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fecd5b7/0x19a927d9c62f19cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d768 expref: 12 pid: 6622 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393174.549667:0:6622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6622:1874217338471424:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393174.549690:0:6622:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ae0dc812/0x19a927d9c62f1c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.549719:0:6622:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ae0dc812/0x19a927d9c62f1c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.549727:0:6622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae0dc812/0x19a927d9c62f1c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.549737:0:6622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae0dc812/0x19a927d9c62f1c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.549745:0:6622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae0dc812/0x19a927d9c62f1c10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.549771:0:6622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787393174.549891:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393174.549913:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae0dc812/0x19a927d9c62f1c10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.549928:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385ba00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393174.549933:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae0dc812/0x19a927d9c62f1c10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.549966:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae0dc812/0x19a927d9c62f1c10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.549993:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae0dc812/0x19a927d9c62f1c10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.550002:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae0dc812/0x19a927d9c62f1c10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.550039:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393174.550040:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393174.550042:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393174.553630:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3327:x1874217338471296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17919us (18049us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787393174.553642:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:3.0:1787393174.554085:0:3327:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9de8351b5500/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787393174.554117:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338471296:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1787393174.617052:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1787393174.617277:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2353:x1874217319588096:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 Request processed in 84262us (84494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393174.617292:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:0.0:1787393174.622648:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393174.622772:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319588480 00000100:00100000:2.0:1787393174.622786:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319588480 00000100:00100000:2.0:1787393174.622918:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 125 00000100:00100000:2.0:1787393174.622933:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:10525:x1874217319588480:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787393174.623022:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393174.623070:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1bf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7fb expref: 15 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.623099:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9de8063da500) 00010000:00010000:2.0:1787393174.623105:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787393174.623150:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f1c17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.623380:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f1c17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.623392:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f1c17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787393174.623720:0:5821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000104b9694 reply state 000000005e959afe transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f1c17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393174.623733:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787393174.624299:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+16:10525:x1874217319588480:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 1365us (1662us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787393174.624310:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 125 00000100:00100000:0.0:1787393174.628940:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393174.629125:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319588608 00000100:00100000:3.0:1787393174.629139:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319588608 00000100:00100000:3.0:1787393174.629232:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 44 00000100:00100000:3.0:1787393174.629245:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2356:x1874217319588608:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787393174.629543:0:7525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787393174.629548:0:7525:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787393174 00002000:00010000:3.0:1787393174.629550:0:7525:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787393174 00002000:00010000:3.0:1787393174.629553:0:7525:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787393174 -> 1787393174 00002000:00010000:3.0:1787393174.629555:0:7525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787393174.629635:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2356:x1874217319588608:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 393us (713us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787393174.629664:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 44 00010000:00010000:2.0:1787393174.629881:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f1c17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.629894:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f1c17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.629902:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f1c17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.629908:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393174.629914:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f1c17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.629923:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f1c17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.629944:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9de8063da500) 00010000:00010000:2.0:1787393174.629955:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393174.629972:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f1c17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.629979:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f1c17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393174.633655:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393174.633923:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319588864 00000100:00100000:3.0:1787393174.633935:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319588864 00000100:00100000:3.0:1787393174.634013:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 126 00000100:00100000:3.0:1787393174.634035:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:10525:x1874217319588864:12345-192.168.203.21@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787393174.634127:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1c1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.634148:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1bd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ed expref: 15 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.634170:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1c1e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.634213:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ed expref: 15 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.634229:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1bd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ed expref: 15 pid: 5820 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393174.634248:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8180ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1874217338471552:192.168.203.21@tcp:104: 00000100:00100000:2.0:1787393174.636928:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818104b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787393174.638758:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8180ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1874217338471552:192.168.203.21@tcp:104: 00010000:00010000:2.0:1787393174.638798:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1c1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393174.640713:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393174.640877:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319588992 00000100:00100000:0.0:1787393174.640893:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319588992 00010000:00010000:0.0:1787393174.640974:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1bd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ed expref: 16 pid: 5820 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393174.641033:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:0.0:1787393174.641044:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+16:2355:x1874217319588992:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787393174.641065:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393174.641074:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1bd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ed expref: 16 pid: 5820 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.641090:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ed expref: 16 pid: 5820 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.641119:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1bd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7ed expref: 16 pid: 5820 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.641147:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9de8063da500) 00010000:00010000:0.0:1787393174.641182:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1c1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.641194:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1c1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.641203:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1c1e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.641249:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787393174.641572:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1c1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.641583:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1c1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.641626:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1c1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.641634:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1c1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.641641:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1c1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.641647:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393174.641651:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1c1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.641659:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1c1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.641681:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9de8063da500) 00010000:00010000:2.0:1787393174.641684:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787393174.641688:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1c1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.641693:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1c1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393174.641771:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:2355:x1874217319588992:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 726us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393174.641781:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:2.0:1787393174.642625:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:10525:x1874217319588864:12345-192.168.203.21@tcp:55:lhsmtool_posix.0 Request processed in 8595us (8976us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787393174.642638:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 126 00000100:00100000:0.0:1787393174.645712:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393174.645792:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319589120 00000100:00100000:2.0:1787393174.645805:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319589120 00000100:00100000:2.0:1787393174.645953:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:2.0:1787393174.645975:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2356:x1874217319589120:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787393174.646051:0:6622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000070deb482/0x19a927d9c62f1c25 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.646078:0:6622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1c02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d809 expref: 7 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.646087:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787393174.646092:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787393174.646097:0:6622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070deb482/0x19a927d9c62f1c25 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.646142:0:6622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1c02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d809 expref: 7 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.646187:0:6622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1c02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d809 expref: 7 pid: 7525 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393174.646204:0:6622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6622:1874217338471680:192.168.203.21@tcp:104: 00000100:00100000:2.0:1787393174.646308:0:6622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de701b719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787393174.652832:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393174.652981:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319589248 00000100:00100000:1.0:1787393174.652993:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319589248 00010000:00010000:1.0:1787393174.653053:0:11945:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1c02 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d809 expref: 8 pid: 7525 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393174.653103:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00100000:1.0:1787393174.653115:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2355:x1874217319589248:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393174.653166:0:11945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393174.653196:0:11945:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1c02 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d809 expref: 8 pid: 7525 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.653213:0:11945:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1c02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d809 expref: 8 pid: 7525 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.653245:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787393174.653251:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787393174.653258:0:11945:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000070deb482/0x19a927d9c62f1c25 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.653269:0:11945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070deb482/0x19a927d9c62f1c25 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.653294:0:11945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393174.653699:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2355:x1874217319589248:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 584us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393174.653710:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 58 00010000:00010000:2.0:1787393174.655401:0:6622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003934a5f6/0x19a927d9c62f1c02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d809 expref: 7 pid: 7525 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393174.655431:0:6622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6622:1874217338471680:192.168.203.21@tcp:104: 00010000:00010000:2.0:1787393174.655466:0:6622:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000070deb482/0x19a927d9c62f1c25 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.655585:0:6622:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000070deb482/0x19a927d9c62f1c25 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.655595:0:6622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070deb482/0x19a927d9c62f1c25 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.655640:0:6622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000070deb482/0x19a927d9c62f1c25 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.655649:0:6622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070deb482/0x19a927d9c62f1c25 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.655658:0:6622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070deb482/0x19a927d9c62f1c25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.655693:0:6622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4000 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393174.655697:0:6622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070deb482/0x19a927d9c62f1c25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.655706:0:6622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070deb482/0x19a927d9c62f1c25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.655728:0:6622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070deb482/0x19a927d9c62f1c25 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.655735:0:6622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070deb482/0x19a927d9c62f1c25 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393174.656209:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2356:x1874217319589120:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 Request processed in 10234us (10508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393174.656221:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:0.0:1787393174.659273:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393174.659357:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319589504 00000100:00100000:2.0:1787393174.659370:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319589504 00000100:00100000:2.0:1787393174.659460:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 127 00000100:00100000:2.0:1787393174.659471:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:10525:x1874217319589504:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787393174.659572:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1c2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.659592:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1c2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.659607:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1c2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.660249:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1c33 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.660266:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1be6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7f4 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.660276:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1c33 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.660328:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1be6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7f4 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393174.660344:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1be6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7f4 expref: 15 pid: 5822 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393174.660361:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834b44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1874217338471808:192.168.203.21@tcp:104: 00000100:00100000:0.0:1787393174.660512:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de81032fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787393174.664508:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834b44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1874217338471808:192.168.203.21@tcp:104: 00010000:00010000:2.0:1787393174.664547:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1c33 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393174.664599:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393174.664680:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319589632 00000100:00100000:2.0:1787393174.664689:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319589632 00010000:00010000:2.0:1787393174.664736:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1be6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7f4 expref: 16 pid: 5822 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393174.664782:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 59 00000100:00100000:2.0:1787393174.664792:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+16:2356:x1874217319589632:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393174.664812:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393174.664820:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1be6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7f4 expref: 16 pid: 5822 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.664833:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1be6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7f4 expref: 16 pid: 5822 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.664881:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1be6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7f4 expref: 16 pid: 5822 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.664910:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9de8063da500) 00010000:00010000:2.0:1787393174.664916:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1c33 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.664926:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1c33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.664954:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1c33 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.664992:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393174.665074:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:2356:x1874217319589632:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 282us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393174.665083:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 59 00010000:00010000:3.0:1787393174.665385:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1c33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.665394:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1c33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787393174.665654:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1787393174.665893:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1787393174.665951:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1787393174.666627:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8180a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5821:1874217338471936:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787393174.666718:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393174.666808:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80fcb40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393174.668493:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338471936 00000100:00100000:1.0:1787393174.668513:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338471936 00000100:00100000:1.0:1787393174.668641:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787393174.668654:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5821:x1874217338471936:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787393174.668827:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5821:x1874217338471936:12345-0@lo:1000:mdt00_001.0 Request processed in 175us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393174.668862:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787393174.669019:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8180a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5821:1874217338471936:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787393174.669678:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787393174.669788:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5821:1874217338472064:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787393174.669890:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393174.670432:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de701b71180 going to sleep for 11 seconds 00000100:00100000:3.0:1787393174.670488:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338472064 00000100:00100000:3.0:1787393174.670497:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338472064 00000100:00100000:3.0:1787393174.670546:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787393174.670557:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5821:x1874217338472064:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787393174.671107:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5821:x1874217338472064:12345-0@lo:1000:mdt00_001.0 Request processed in 405us (1070us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787393174.671118:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787393174.671346:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5821:1874217338472064:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787393174.671403:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1c33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.671415:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1c33 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.671423:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1c33 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.671431:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761ca00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393174.671437:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1c33 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.671446:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1c33 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.671487:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9de8063da500) 00010000:00010000:2.0:1787393174.671490:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787393174.671495:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1c33 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.671501:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1c33 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.671540:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1b76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.671546:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1b76 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.671552:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1b76 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.671557:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393174.671559:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1b76 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.671565:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1b76 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.671572:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:2.0:1787393174.671575:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787393174.671583:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1b7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7d8 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.671596:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1b7d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7d8 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.671613:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1b7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7d8 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.671654:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1b7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7d8 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393174.671670:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1874217338472192:192.168.203.21@tcp:105: 00000100:00100000:2.0:1787393174.671824:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de701b71180 going to sleep for 11 seconds 00000100:00100000:1.0:1787393174.675902:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393174.676145:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319589760 00000100:00100000:3.0:1787393174.676170:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319589760 00000100:00100000:3.0:1787393174.676246:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 31 00000100:00100000:3.0:1787393174.676257:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:10524:x1874217319589760:12345-192.168.203.21@tcp:49:lfs.0 00000100:00100000:3.0:1787393174.676831:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:10524:x1874217319589760:12345-192.168.203.21@tcp:49:lfs.0 Request processed in 572us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393174.676869:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 31 00000100:00100000:2.0:1787393174.677378:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1874217338472192:192.168.203.21@tcp:105: 00010000:00010000:2.0:1787393174.677415:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1b76 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.677428:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1b76 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.677824:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1c3a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.677870:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1c3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.677884:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1c3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.677895:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1c3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.677907:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1c3a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.677931:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1c3a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.677937:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393174.677941:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1c3a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.677949:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1c3a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.678138:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:2.0:1787393174.678142:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393174.678147:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1c3a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.678212:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f1c3a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.678227:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1c2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.678233:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1c2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.678239:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1c2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.678245:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393174.678248:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1c2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.678266:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1c2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.678275:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:2.0:1787393174.678278:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787393174.678281:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1c2c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.678287:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f1c2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393174.678575:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+18:10525:x1874217319589504:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 19101us (19310us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1787393174.678587:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 127 00000020:00080000:2.0:1787393174.678593:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787393174.680359:0:11566:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787393174.680372:0:11566:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787393174.680821:0:11566:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787393174.680831:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787393174.682704:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393174.682793:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319590016 00000100:00100000:2.0:1787393174.682807:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319590016 00000100:00100000:2.0:1787393174.682912:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 128 00000100:00100000:2.0:1787393174.682925:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+18:10524:x1874217319590016:12345-192.168.203.21@tcp:58:lfs.0 00000040:00080000:2.0:1787393174.685234:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787393174.685394:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+18:10524:x1874217319590016:12345-192.168.203.21@tcp:58:lfs.0 Request processed in 2465us (2696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393174.685407:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 128 00000100:00100000:3.0:1787393174.688093:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393174.688330:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319590272 00000100:00100000:2.0:1787393174.688345:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319590272 00000100:00100000:2.0:1787393174.688472:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00100000:2.0:1787393174.688484:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818e26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+18:10525:x1874217319590272:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787393174.689400:0:5824:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787393174.689520:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1787393174.689579:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f1c41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.689598:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f1c41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.689613:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f1c41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.689624:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f1c41 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.689631:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f1c41 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.689638:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f1c41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393174.689666:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787393174.689800:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818e26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:10525:x1874217319590272:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 1314us (1717us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787393174.689810:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 32 00000020:00080000:2.0:1787393174.689817:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787393174.689973:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393174.689982:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f1c41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.689990:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5c00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393174.689995:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f1c41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.690017:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f1c41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.690043:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9de818bd8c00) 00010000:00010000:3.0:1787393174.690047:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787393174.690056:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f1c41 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.690062:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f1c41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.690083:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393174.690084:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393174.690086:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393174.718508:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393174.719243:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319590400 00000100:00100000:1.0:1787393174.719259:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319590400 00000100:00100000:1.0:1787393174.719398:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 129 00000100:00100000:1.0:1787393174.722174:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:10527:x1874217319590400:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393174.722224:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393174.722260:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1c48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d810 expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.722355:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1c4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.722374:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1c4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.722389:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1c4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.722407:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1c56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.722414:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.722421:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.722813:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1c5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.722828:0:10433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1b68 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7d1 expref: 21 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.722871:0:10433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1c5d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.722922:0:10433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1b68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7d1 expref: 21 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.722943:0:10433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1b68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7d1 expref: 21 pid: 10433 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393174.722961:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8186b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338472320:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393174.723121:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787393174.732012:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393174.732209:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319590656 00000100:00100000:2.0:1787393174.732223:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319590656 00000100:00100000:2.0:1787393174.732291:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:2.0:1787393174.732303:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+22:5566:x1874217319590656:12345-192.168.203.21@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787393174.732699:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8186b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338472320:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393174.732728:0:10433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1c5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393174.735584:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:5566:x1874217319590656:12345-192.168.203.21@tcp:35:ldlm_bl.0 Request processed in 3268us (3571us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1787393174.735602:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:3.0:1787393174.738511:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393174.738613:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319590784 00000100:00100000:1.0:1787393174.738627:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319590784 00010000:00010000:1.0:1787393174.738683:0:11945:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1b68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7d1 expref: 23 pid: 10433 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393174.738734:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:1.0:1787393174.738764:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de826cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:2356:x1874217319590784:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393174.738785:0:11945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393174.738793:0:11945:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1b68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7d1 expref: 23 pid: 10433 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.738810:0:11945:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1b68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7d1 expref: 23 pid: 10433 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.738878:0:11945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1b68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7d1 expref: 23 pid: 10433 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.738900:0:11945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:1.0:1787393174.738905:0:11945:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1c5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.738917:0:11945:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1c5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.738926:0:11945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1c5d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393174.738973:0:11945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393174.739047:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de826cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+22:2356:x1874217319590784:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 285us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393174.739056:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 60 00010000:00010000:3.0:1787393174.739081:0:10433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1c5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739091:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1c5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393174.739147:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787393174.739162:0:10433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787393174.739189:0:10433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1c5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739204:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1c5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739216:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1c4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739233:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1c4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739240:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1c4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739247:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393174.739251:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1c4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739259:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1c4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739270:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:3.0:1787393174.739274:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393174.739278:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1c4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739283:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1c4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739295:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739301:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1c56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739306:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1c56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739311:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393174.739318:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1c56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739324:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1c56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739331:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9de81aa54e00) 00010000:00010000:3.0:1787393174.739333:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393174.739336:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1c56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739341:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1c56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739383:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1c48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d810 expref: 22 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739397:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1c5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d810 expref: 21 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393174.739404:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:3.0:1787393174.739406:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787393174.739408:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385b800, rc 0) 00000100:00100000:3.0:1787393174.739454:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10527:x1874217319590400:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 20047us (20973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393174.739462:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 129 00000100:00100000:1.0:1787393174.888136:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787393174.888159:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338472448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787393174.888296:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393174.888804:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338472448 00000100:00100000:2.0:1787393174.888819:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338472448 00000100:00100000:2.0:1787393174.888889:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787393174.888972:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3326:x1874217338472448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787393174.888992:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393174.889053:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3326:x1874217338472448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393174.889060:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787393174.889317:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338472448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787393175.016879:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787393175.657813:0:11983:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787393175.657823:0:11983:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787393175.658766:0:11983:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787393175.658774:0:11983:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787393175.720155:0:11566:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787393175.720165:0:11566:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787393175.720227:0:11566:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787393175.720237:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787393175.720384:0:11566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8180ab100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11566:1874217338472576:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787393175.720515:0:11566:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80801b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787393175.724279:0:11566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8180ab100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11566:1874217338472576:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787393175.731366:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393175.731530:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319590912 00000100:00100000:0.0:1787393175.731544:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319590912 00000100:00100000:0.0:1787393175.731642:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 130 00000100:00100000:0.0:1787393175.731656:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10539:x1874217319590912:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787393175.731707:0:5820:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787393175.731867:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10539:x1874217319590912:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 188us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393175.731876:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 130 00000100:00080000:2.0:1787393175.732166:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393175.739178:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393175.740074:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319591168 00000100:00100000:2.0:1787393175.740099:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319591168 00000100:00100000:2.0:1787393175.740200:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 131 00000100:00100000:2.0:1787393175.740213:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:10539:x1874217319591168:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787393175.740243:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393175.740272:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1c64 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d817 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393175.740571:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1c6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393175.740590:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1c6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393175.740606:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1c6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393175.740621:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787393175.740791:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1c64 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d817 expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393175.740830:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1c6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d817 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393175.740867:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:2.0:1787393175.740872:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787393175.740876:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5000, rc 0) 00000100:00100000:2.0:1787393175.740966:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:10539:x1874217319591168:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 753us (1803us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787393175.740975:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 131 00000100:00100000:1.0:1787393175.762300:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393175.762363:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393175.762430:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319591552 00000100:00100000:2.0:1787393175.762444:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319591552 00000100:00100000:2.0:1787393175.762523:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 132 00000100:00100000:2.0:1787393175.762536:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:10539:x1874217319591552:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787393175.762648:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319591296 00010000:00010000:2.0:1787393175.762655:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1c79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393175.762668:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319591296 00010000:00010000:2.0:1787393175.762682:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1c79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393175.762699:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1c79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393175.762742:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:3.0:1787393175.762757:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+24:2355:x1874217319591296:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787393175.762774:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393175.762802:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1c6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d817 expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393175.762821:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:3.0:1787393175.762826:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393175.762942:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:2355:x1874217319591296:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 189us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393175.762951:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00010000:00010000:2.0:1787393175.763058:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1c79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393175.763071:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1c79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393175.763110:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1c79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393175.763117:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393175.763122:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1c79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393175.763131:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1c79 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393175.763146:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:2.0:1787393175.763149:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787393175.763155:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1c79 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393175.763160:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1c79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393175.763327:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:10539:x1874217319591552:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 791us (960us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787393175.763335:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 132 00000040:00080000:2.0:1787393175.763537:0:11566:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787393175.763543:0:11566:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787393175.763996:0:11566:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787393175.764006:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787393175.771446:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393175.772774:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319591808 00000100:00100000:3.0:1787393175.772787:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319591808 00000100:00100000:3.0:1787393175.772889:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:3.0:1787393175.772902:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:10539:x1874217319591808:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787393175.773229:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+24:10539:x1874217319591808:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 329us (1794us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787393175.773935:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 34 00010000:00010000:3.0:1787393176.040141:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393177.067736:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787393177.398699:0:12035:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787393177.398716:0:12035:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787393177.398783:0:12035:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787393177.398790:0:12035:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787393177.614474:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393177.614678:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319592064 00000100:00100000:0.0:1787393177.614692:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319592064 00000100:00100000:0.0:1787393177.614764:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 133 00000100:00100000:0.0:1787393177.614775:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+24:10560:x1874217319592064:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1787393177.614813:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393177.614835:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1c80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d81e expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393177.614965:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1c87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393177.614978:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1c87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393177.614989:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1c87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393177.615012:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787393177.615133:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1c80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d81e expref: 27 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393177.615150:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1c87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d81e expref: 26 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393177.615159:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:0.0:1787393177.615162:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787393177.615165:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761d000, rc 0) 00000100:00100000:0.0:1787393177.615230:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+26:10560:x1874217319592064:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 457us (765us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787393177.615237:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 133 00000100:00080000:2.0:1787393177.621253:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393177.622249:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393177.622343:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319592192 00000100:00100000:2.0:1787393177.622353:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319592192 00000100:00100000:2.0:1787393177.622457:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 134 00000100:00100000:2.0:1787393177.622468:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+26:10560:x1874217319592192:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:2.0:1787393177.622541:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1c95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393177.622558:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393177.622737:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393177.622764:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393177.622771:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1c95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393177.622778:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1c95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393177.622784:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393177.622788:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1c95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393177.622796:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1c95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393177.622808:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:2.0:1787393177.622811:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787393177.622815:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1c95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393177.622830:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1c95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393177.623231:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+26:10560:x1874217319592192:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 763us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393177.623239:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 134 00000100:00100000:1.0:1787393177.698115:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393177.701032:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319592320 00000100:00100000:3.0:1787393177.701050:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319592320 00000100:00100000:3.0:1787393177.701218:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00100000:3.0:1787393177.701230:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2353:x1874217319592320:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:3.0:1787393177.701249:0:7525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393177.701270:0:7525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b6444ad/0x19a927d9c62f1c9c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d825 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787393177.701296:0:7525:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a897496, atime: 0x6a897496, ctime: 0x6a897496, blocks: 0xb 00010000:00010000:3.0:1787393177.701325:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=326s v=(0 0) 00010000:00010000:3.0:1787393177.701330:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393177.701339:0:7525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b6444ad/0x19a927d9c62f1c9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d825 expref: 7 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393177.701356:0:7525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b6444ad/0x19a927d9c62f1c9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d825 expref: 7 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393177.701369:0:7525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531800, rc 0) 00000100:00100000:3.0:1787393177.701440:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2353:x1874217319592320:12345-192.168.203.21@tcp:101:cat.0 Request processed in 213us (3335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393177.701447:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00080000:2.0:1787393177.702341:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787393177.705299:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393177.705410:0:6628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319592448 00000100:00100000:2.0:1787393177.705421:0:6628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319592448 00002000:00100000:2.0:1787393177.705470:0:6628:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9de834b45180 x1874217319592448/t0(0) o3->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:148/0 lens 488/0 e 0 to 0 dl 1787393188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787393177.705481:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de834b45180 with x1874217319592448 ext(0->4095) 00002000:00010000:2.0:1787393177.705486:0:6628:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de834b45180 00000100:00100000:2.0:1787393177.705548:0:6628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:2.0:1787393177.705557:0:6628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2354:x1874217319592448:12345-192.168.203.21@tcp:3:cat.0 00000100:00100000:2.0:1787393177.705959:0:6628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2354:x1874217319592448:12345-192.168.203.21@tcp:3:cat.0 Request processed in 401us (667us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787393177.705966:0:6628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00002000:00100000:2.0:1787393177.705973:0:6628:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9de834b45180 x1874217319592448/t0(0) o3->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:148/0 lens 488/4536 e 0 to 0 dl 1787393188 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787393177.705981:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de834b45180 with x1874217319592448 ext(0->4095) 00002000:00010000:2.0:1787393177.705984:0:6628:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de834b45180 00010000:00010000:3.0:1787393178.098772:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393178.453946:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393178.454009:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393178.454061:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393178.454148:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319592576 00000100:00100000:2.0:1787393178.454158:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319592576 00000100:00100000:2.0:1787393178.454207:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 285 00000100:00100000:2.0:1787393178.454224:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:2354:x1874217319592576:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393178.454292:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:2354:x1874217319592576:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 71us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393178.454299:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 285 00000100:00100000:3.0:1787393178.454530:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319592832 00000100:00100000:3.0:1787393178.454535:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319592832 00000100:00100000:3.0:1787393178.454577:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:3.0:1787393178.454585:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2354:x1874217319592832:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393178.454622:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2354:x1874217319592832:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 39us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393178.454629:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:0.0:1787393178.455215:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393178.455743:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319593088 00000100:00100000:1.0:1787393178.455750:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319593088 00000100:00100000:3.0:1787393178.455765:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319592704 00000100:00100000:3.0:1787393178.455769:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319592704 00000100:00100000:3.0:1787393178.455803:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 131 00000100:00100000:3.0:1787393178.455811:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+26:2354:x1874217319592704:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393178.456224:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 132 00000100:00100000:1.0:1787393178.456233:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2354:x1874217319593088:12345-192.168.203.21@tcp:400:kworker.0 00000100:00080000:2.0:1787393178.456861:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393178.457225:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+26:2354:x1874217319592704:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 1409us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393178.457235:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 131 00000100:00100000:0.0:1787393178.457777:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393178.457939:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319592960 00000100:00100000:3.0:1787393178.457947:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319592960 00000100:00100000:3.0:1787393178.458009:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00100000:3.0:1787393178.458019:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2354:x1874217319592960:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393178.458769:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2354:x1874217319592960:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 748us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393178.458779:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00080000:3.0:1787393178.458801:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787393178.459836:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2354:x1874217319593088:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 3591us (5761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393178.459861:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 132 00000001:00080000:3.0:1787393178.537959:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1787393178.537974:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000004:00080000:3.0:1787393178.987249:0:6770:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328162406357ns, next at 329162403556ns, rc = 0 00000100:00100000:2.0:1787393178.987378:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8180ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338472704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787393178.987469:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393178.992409:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338472704 00000100:00100000:3.0:1787393178.992424:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338472704 00000100:00080000:2.0:1787393178.992518:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787393178.992685:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787393178.992709:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3324:x1874217338472704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787393178.992750:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787393178.992882:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3324:x1874217338472704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (5404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393178.992891:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787393178.992956:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8180ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338472704:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787393179.114095:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393179.496098:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338472832:0@lo:400:kworker.0 00000100:00100000:3.0:1787393179.496221:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393179.496247:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874217338472960:0@lo:400:kworker.0 00000100:00100000:1.0:1787393179.496285:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393179.496312:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787393179.496318:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8082ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338473088:0@lo:400:kworker.0 00000100:00100000:1.0:1787393179.496341:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393179.496380:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338472960 00000100:00100000:1.0:1787393179.496540:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338472960 00000100:00100000:1.0:1787393179.496896:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338473088 00000100:00100000:1.0:1787393179.496901:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338473088 00000100:00100000:1.0:1787393179.496970:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787393179.496982:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1874217338472960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393179.497069:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1874217338472960:12345-0@lo:400:kworker.0 Request processed in 89us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393179.497076:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787393179.497098:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787393179.497105:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338473088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393179.497427:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338473216:0@lo:400:kworker.0 00000100:00100000:0.0:1787393179.497479:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393179.497503:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787393179.497510:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338473344:0@lo:400:kworker.0 00000100:00100000:0.0:1787393179.497536:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393179.497555:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338473088:12345-0@lo:400:kworker.0 Request processed in 450us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393179.497563:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787393179.497577:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338473216 00000100:00100000:1.0:1787393179.497580:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338473216 00000100:00100000:2.0:1787393179.497860:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338473344 00000100:00100000:2.0:1787393179.497865:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338473344 00000100:00100000:2.0:1787393179.497904:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787393179.497912:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338473344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393179.497961:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338473344:12345-0@lo:400:kworker.0 Request processed in 50us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393179.497968:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787393179.498016:0:3324:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787393179.498024:0:3324:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1787393179.498048:0:3324:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9de83f5f4700, transno 4294967304 00000100:00100000:2.0:1787393179.498061:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338473344:0@lo:400:kworker.0 00000100:00080000:1.0:1787393179.498577:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787393179.498588:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393179.499021:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787393179.499047:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338473216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393179.499570:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338473216:12345-0@lo:400:kworker.0 Request processed in 535us (2089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393179.499579:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787393179.500142:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338472832 00000100:00100000:3.0:1787393179.500159:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338472832 00000100:00100000:3.0:1787393179.500929:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787393179.500942:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338472832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393179.501034:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338472832:12345-0@lo:400:kworker.0 Request processed in 95us (4813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393179.501042:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787393179.501102:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338472832:0@lo:400:kworker.0 00000100:00100000:1.0:1787393179.508565:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8082ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338473088:0@lo:400:kworker.0 00000100:00100000:1.0:1787393179.508590:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874217338472960:0@lo:400:kworker.0 00000100:00100000:1.0:1787393179.508671:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338473216:0@lo:400:kworker.0 00000001:00080000:3.0:1787393179.660530:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1787393179.660547:0:5842:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1787393179.660585:0:5842:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9de701b71300 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787393179.660591:0:5842:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9de8418cf500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9de701b71d80 00000020:00080000:3.0:1787393179.660594:0:5842:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9de8418cfe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9de83c59fc00 00000004:00080000:3.0:1787393179.660607:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:3.0:1787393179.660693:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8180a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338473472:0@lo:2:osp-syn-0-0.0 00000020:00080000:0.0:1787393179.660822:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000100:00100000:3.0:1787393179.661434:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393179.661508:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338473472 00000100:00100000:3.0:1787393179.661516:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338473472 00000020:00080000:0.0:1787393179.661681:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1787393179.662282:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787393179.662295:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3326:x1874217338473472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787393179.662466:0:7525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787393179.662470:0:7525:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787393174 -> 1787393174 00002000:00010000:3.0:1787393179.662472:0:7525:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1787393174 -> 1787393174 00002000:00010000:3.0:1787393179.662474:0:7525:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787393174 -> 1787393174 00002000:00010000:3.0:1787393179.662477:0:7525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787393179.662532:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3326:x1874217338473472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 241us (1099us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787393179.662540:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000004:00080000:0.0:1787393179.664473:0:3326:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9de8180a8380/2, rc 0, transno 4294967313 00000100:00100000:0.0:1787393179.664485:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8180a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338473472:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787393180.008138:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338473600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787393180.008223:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393180.008320:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338473600 00000100:00100000:2.0:1787393180.008328:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338473600 00000100:00100000:2.0:1787393180.008394:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787393180.008405:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338473600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787393180.008466:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393180.008533:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338473600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393180.008542:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787393180.008641:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338473600:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787393180.073397:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1787393180.073411:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1787393180.073418:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:3.0:1787393180.141048:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393181.160181:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787393181.931998:0:11566:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787393181.932008:0:11566:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787393181.932071:0:11566:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787393181.932078:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787393182.185426:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393182.599250:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393182.602271:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319593216 00000100:00100000:0.0:1787393182.602294:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319593216 00000100:00100000:2.0:1787393182.604626:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 135 00000100:00100000:2.0:1787393182.604645:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:10204:x1874217319593216:12345-192.168.203.21@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787393182.604827:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:10204:x1874217319593216:12345-192.168.203.21@tcp:60:lhsmtool_posix.0 Request processed in 177us (5582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393182.604835:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 135 00000100:00080000:1.0:1787393182.604958:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393182.625739:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393182.627532:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319593472 00000100:00100000:1.0:1787393182.627553:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319593472 00000100:00100000:1.0:1787393182.627712:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00100000:1.0:1787393182.627724:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:10204:x1874217319593472:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787393182.628712:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:10204:x1874217319593472:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 982us (2979us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787393182.628726:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00100000:0.0:1787393182.886155:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393182.886261:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319593600 00000100:00100000:1.0:1787393182.886291:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319593600 00000100:00100000:1.0:1787393182.886410:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 136 00000100:00100000:1.0:1787393182.886425:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:11012:x1874217319593600:12345-192.168.203.21@tcp:101:lsof.0 00010000:00010000:1.0:1787393182.886455:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393182.886483:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1ca3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d82c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393182.886569:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1caa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393182.886586:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1caa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393182.886601:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1caa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393182.886911:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787393182.886916:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393182.887045:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1caa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393182.887080:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1ca3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d82c expref: 7 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393182.887116:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1caa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d82c expref: 6 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393182.887126:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54c00) 00010000:00010000:1.0:1787393182.887129:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787393182.887133:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385b400, rc 0) 00000100:00100000:1.0:1787393182.887219:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:11012:x1874217319593600:12345-192.168.203.21@tcp:101:lsof.0 Request processed in 797us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393182.887228:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 136 00000100:00080000:2.0:1787393182.891132:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787393183.210142:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393183.574010:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393183.574070:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393183.574112:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393183.574151:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393183.574191:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319594112 00000100:00100000:0.0:1787393183.574201:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319594112 00000100:00100000:0.0:1787393183.574253:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319593984 00000100:00100000:0.0:1787393183.574257:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319593984 00000100:00100000:0.0:1787393183.574297:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:0.0:1787393183.574306:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2354:x1874217319594112:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393183.574391:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2354:x1874217319594112:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 87us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393183.574399:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:0.0:1787393183.574417:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:0.0:1787393183.574422:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2354:x1874217319593984:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393183.574444:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2354:x1874217319593984:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 23us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393183.574450:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:1.0:1787393183.574617:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319593728 00000100:00100000:1.0:1787393183.574621:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319593728 00000100:00100000:1.0:1787393183.574653:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 287 00000100:00100000:1.0:1787393183.574660:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:2354:x1874217319593728:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393183.574691:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:2354:x1874217319593728:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 32us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393183.574696:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 287 00000100:00080000:2.0:1787393183.574984:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787393183.574989:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787393183.575000:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319593856 00000100:00100000:2.0:1787393183.575004:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319593856 00000100:00100000:2.0:1787393183.575042:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 136 00000100:00100000:2.0:1787393183.575049:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:2354:x1874217319593856:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393183.575092:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:2354:x1874217319593856:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 43us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393183.575099:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 136 00000100:00100000:0.0:1787393184.104281:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787393184.104303:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338473728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787393184.104374:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393184.104864:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338473728 00000100:00100000:2.0:1787393184.104873:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338473728 00000100:00100000:2.0:1787393184.104942:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787393184.104951:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338473728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787393184.104999:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393184.105361:0:3325:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1787393184.105368:0:3325:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9de8351b5500, transno 4294967310 00000004:00080000:0.0:1787393184.105377:0:3325:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967313 00000004:00080000:0.0:1787393184.105394:0:3325:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9de8180a8380, transno 4294967313 00000100:00100000:0.0:1787393184.105405:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338473728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787393184.105526:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338473728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 575us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393184.105535:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1787393184.106569:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787393184.232569:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393184.616228:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8180a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338474112:0@lo:400:kworker.0 00000100:00100000:3.0:1787393184.616301:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393184.616363:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787393184.616369:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338473984:0@lo:400:kworker.0 00000100:00100000:3.0:1787393184.616392:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393184.616425:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338474112 00000100:00100000:3.0:1787393184.616433:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338474112 00000100:00100000:3.0:1787393184.616482:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338473984 00000100:00100000:3.0:1787393184.616485:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338473984 00000100:00100000:3.0:1787393184.616517:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787393184.616525:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338474112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393184.616607:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338474112:12345-0@lo:400:kworker.0 Request processed in 82us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393184.616614:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787393184.616634:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787393184.616642:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338473984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393184.616673:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338473984:12345-0@lo:400:kworker.0 Request processed in 32us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393184.616679:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1787393184.616699:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393184.616739:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338473984:0@lo:400:kworker.0 00000100:00100000:3.0:1787393184.616751:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8180a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338474112:0@lo:400:kworker.0 00000100:00100000:3.0:1787393184.616798:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338473856:0@lo:400:kworker.0 00000100:00100000:3.0:1787393184.616833:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393184.616970:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83d5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338474240:0@lo:400:kworker.0 00000100:00100000:1.0:1787393184.617005:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393184.617150:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338474240 00000100:00100000:3.0:1787393184.617155:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338474240 00000100:00100000:3.0:1787393184.617193:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787393184.617201:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338474240:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787393184.622474:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393184.622522:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83d5aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338474368:0@lo:400:kworker.0 00000100:00100000:2.0:1787393184.622659:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338473856 00000100:00100000:2.0:1787393184.622669:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338473856 00000100:00100000:2.0:1787393184.623434:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787393184.623444:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338473856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393184.623514:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338473856:12345-0@lo:400:kworker.0 Request processed in 72us (6680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393184.623521:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787393184.623743:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393184.623798:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338473856:0@lo:400:kworker.0 00000100:00100000:3.0:1787393184.623996:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338474240:12345-0@lo:400:kworker.0 Request processed in 6795us (6989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393184.624006:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787393184.624041:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83d5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338474240:0@lo:400:kworker.0 00000100:00100000:2.0:1787393184.624239:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338474368 00000100:00100000:2.0:1787393184.624245:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338474368 00000100:00100000:2.0:1787393184.624285:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787393184.624291:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8082ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338474368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393184.624337:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8082ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338474368:12345-0@lo:400:kworker.0 Request processed in 47us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393184.624344:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787393184.624361:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787393184.624464:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83d5aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338474368:0@lo:400:kworker.0 00000020:00080000:1.0:1787393184.650665:0:5842:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1787393184.650769:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787393184.650780:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:1.0:1787393184.650949:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000100:00100000:0.0:1787393185.128538:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338474496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787393185.128610:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393185.128898:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338474496 00000100:00100000:2.0:1787393185.128905:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338474496 00000100:00100000:2.0:1787393185.128971:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787393185.128982:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338474496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787393185.129016:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393185.129068:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338474496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393185.129164:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787393185.129782:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de810337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338474496:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787393185.256607:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393186.281005:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787393186.470421:0:12238:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 06:06:25 (1787393185) 00010000:00010000:1.0:1787393187.304409:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393187.831023:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393187.831104:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319594368 00000100:00100000:3.0:1787393187.831114:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319594368 00000100:00100000:3.0:1787393187.831193:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 137 00000100:00080000:2.0:1787393187.831197:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393187.831218:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:11278:x1874217319594368:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787393187.831240:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393187.831334:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1cb1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d833 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393187.831409:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1cb8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393187.831423:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1cb8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393187.831437:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1cb8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393187.831605:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cbf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393187.831614:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cbf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393187.831621:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cbf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.832459:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f1cc6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.832475:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f1cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.832614:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f1cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393187.832628:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787393187.833011:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1cb8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.833020:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1cb8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.833028:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1cb8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.833034:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393187.833039:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1cb8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.833046:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1cb8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.833059:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9de8184fcf00) 00010000:00010000:2.0:1787393187.833062:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393187.833066:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1cb8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.833083:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1cb8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.833097:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cbf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.833104:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cbf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.833110:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cbf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.833115:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393187.833118:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cbf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.833124:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cbf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.833132:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9de8063dae00) 00010000:00010000:2.0:1787393187.833135:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393187.833138:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cbf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.833143:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cbf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.833739:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1cb1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d833 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.833832:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f1cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d833 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393187.833903:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9de8184fc100) 00010000:00010000:2.0:1787393187.833906:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393187.833909:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5e00, rc 0) 00000100:00100000:2.0:1787393187.834224:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:11278:x1874217319594368:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 3007us (3209us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787393187.834233:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 137 00000100:00100000:2.0:1787393187.842910:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393187.842961:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393187.843120:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319594624 00000100:00100000:1.0:1787393187.843138:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319594624 00000100:00100000:1.0:1787393187.843197:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 138 00000100:00100000:1.0:1787393187.843207:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de810337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:11278:x1874217319594624:12345-192.168.203.21@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787393187.843314:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de810337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:11278:x1874217319594624:12345-192.168.203.21@tcp:59:lhsmtool_posix.0 Request processed in 109us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393187.843322:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 138 00000100:00100000:0.0:1787393187.843537:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319594496 00000100:00100000:0.0:1787393187.843542:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319594496 00000100:00100000:0.0:1787393187.843613:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:0.0:1787393187.843621:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:2356:x1874217319594496:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787393187.843890:0:11945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393187.843917:0:11945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f1cc6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d833 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393187.843945:0:11945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9de8184fc100) 00010000:00010000:0.0:1787393187.843950:0:11945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393187.843977:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:2356:x1874217319594496:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 358us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393187.843985:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000040:00080000:3.0:1787393188.074508:0:11566:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787393188.074516:0:11566:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787393188.074990:0:11566:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787393188.074999:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787393188.328411:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393188.697118:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393188.697155:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393188.697173:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393188.697191:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393188.697212:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393188.697235:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319595264 00000100:00100000:0.0:1787393188.697244:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319595264 00000100:00100000:0.0:1787393188.697295:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319594880 00000100:00100000:0.0:1787393188.697299:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319594880 00000100:00100000:0.0:1787393188.697317:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 140 00000100:00100000:0.0:1787393188.697327:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:2355:x1874217319595264:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393188.697398:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:2355:x1874217319595264:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 72us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393188.697406:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 140 00000100:00100000:0.0:1787393188.697425:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 141 00000100:00100000:0.0:1787393188.697431:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:2355:x1874217319594880:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393188.697469:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:2355:x1874217319594880:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 39us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393188.697475:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 141 00000100:00080000:0.0:1787393188.697495:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393188.697648:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319594752 00000100:00100000:3.0:1787393188.697654:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319594752 00000100:00100000:3.0:1787393188.697691:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 289 00000100:00100000:3.0:1787393188.697704:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319594752:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393188.697751:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319594752:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 35us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393188.697758:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 289 00000100:00100000:3.0:1787393188.697789:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319595008 00000100:00100000:3.0:1787393188.697792:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319595008 00000100:00100000:3.0:1787393188.697835:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319595136 00000100:00100000:3.0:1787393188.697861:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319595136 00000100:00100000:3.0:1787393188.697891:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 67 00000100:00100000:3.0:1787393188.697898:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319595008:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393188.697939:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319595008:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 41us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393188.697945:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 67 00000100:00100000:3.0:1787393188.697957:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:3.0:1787393188.697964:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2355:x1874217319595136:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393188.697986:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2355:x1874217319595136:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 24us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393188.697992:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00080000:3.0:1787393188.698065:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787393188.698068:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787393189.228515:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787393189.228537:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338474624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787393189.228605:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393189.228664:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338474624 00000100:00100000:2.0:1787393189.228672:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338474624 00000100:00100000:2.0:1787393189.228724:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787393189.228732:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338474624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787393189.228767:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393189.228810:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338474624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393189.228817:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1787393189.228835:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787393189.228891:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338474624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787393189.351947:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393189.736949:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de80ba1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338474880:0@lo:400:kworker.0 00000100:00100000:2.0:1787393189.737014:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393189.737066:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787393189.737084:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de80ba18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338474752:0@lo:400:kworker.0 00000100:00100000:2.0:1787393189.737112:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393189.737136:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338475264:0@lo:400:kworker.0 00000100:00100000:2.0:1787393189.737159:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393189.737186:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338475008:0@lo:400:kworker.0 00000100:00100000:2.0:1787393189.737208:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393189.737246:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338474880 00000100:00100000:2.0:1787393189.737253:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338474880 00000100:00100000:2.0:1787393189.737293:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338475008 00000100:00100000:2.0:1787393189.737296:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338475008 00000100:00100000:2.0:1787393189.737322:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787393189.737330:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fcc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338474880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393189.737381:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fcc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338474880:12345-0@lo:400:kworker.0 Request processed in 51us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393189.737389:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787393189.737410:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787393189.737415:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338475008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393189.737445:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338475008:12345-0@lo:400:kworker.0 Request processed in 30us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393189.737452:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787393189.737499:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338475264 00000100:00100000:3.0:1787393189.737504:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338475264 00000100:00100000:3.0:1787393189.737543:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787393189.737551:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83fccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338475264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393189.737584:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83fccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338475264:12345-0@lo:400:kworker.0 Request processed in 34us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393189.737598:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787393189.737616:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338474752 00000100:00100000:3.0:1787393189.737620:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338474752 00000100:00100000:3.0:1787393189.737643:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787393189.737649:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338474752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393189.737679:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3325:x1874217338474752:12345-0@lo:400:kworker.0 Request processed in 29us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393189.737685:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:2.0:1787393189.737717:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787393189.737721:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393189.738196:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338475136:0@lo:400:kworker.0 00000100:00100000:3.0:1787393189.738315:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de80ba18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338474752:0@lo:400:kworker.0 00000100:00100000:2.0:1787393189.741437:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338475008:0@lo:400:kworker.0 00000100:00100000:0.0:1787393189.742514:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393189.742570:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338475136 00000100:00100000:0.0:1787393189.742578:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338475136 00000100:00100000:0.0:1787393189.742643:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787393189.742651:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874217338475136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393189.742709:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874217338475136:12345-0@lo:400:kworker.0 Request processed in 58us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393189.742715:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:0.0:1787393189.742738:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393189.742769:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338475136:0@lo:400:kworker.0 00000100:00100000:3.0:1787393189.746833:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338475264:0@lo:400:kworker.0 00000100:00100000:3.0:1787393189.747644:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de80ba1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338474880:0@lo:400:kworker.0 00000001:00080000:2.0:1787393189.778216:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:0.0:1787393189.823422:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393189.823765:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319595392 00000100:00100000:3.0:1787393189.823775:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319595392 00000100:00100000:3.0:1787393189.823879:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 139 00000100:00100000:3.0:1787393189.823890:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:11320:x1874217319595392:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1787393189.823909:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393189.823939:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1cd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d83a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824003:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cdb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824016:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824028:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824051:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ce2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824059:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824066:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824324:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824332:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cdb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824338:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cdb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824343:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393189.824347:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cdb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824354:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cdb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824365:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54c00) 00010000:00010000:3.0:1787393189.824368:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393189.824371:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824377:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1cdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824391:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824396:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ce2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824402:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824407:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393189.824409:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824415:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ce2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824422:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9de8063da400) 00010000:00010000:3.0:1787393189.824424:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393189.824427:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ce2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824432:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1ce2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824461:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1cd4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d83a expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824470:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54c00) 00010000:00010000:3.0:1787393189.824473:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393189.824483:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1cd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d83a expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393189.824492:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531600, rc 0) 00000100:00080000:0.0:1787393189.825028:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393189.825218:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:11320:x1874217319595392:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1328us (1802us total) trans 0 rc 301/301 00000100:00100000:3.0:1787393189.825226:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 139 00000100:00100000:3.0:1787393189.833104:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393189.836017:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319595648 00000100:00100000:0.0:1787393189.836032:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319595648 00000100:00100000:0.0:1787393189.836115:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 140 00000100:00100000:0.0:1787393189.836126:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:11320:x1874217319595648:12345-192.168.203.21@tcp:36:lfs.0 00010000:00010000:0.0:1787393189.836180:0:10433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393189.836207:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1652 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d673 expref: 13 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393189.836235:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54c00) 00010000:00010000:0.0:1787393189.836240:0:10433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787393189.836501:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ce9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393189.836515:0:10433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1caa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d82c expref: 5 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393189.836523:0:10433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ce9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393189.836555:0:10433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1caa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d82c expref: 5 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393189.836569:0:10433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1caa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d82c expref: 5 pid: 5821 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393189.836583:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82c8d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338475392:192.168.203.21@tcp:104: 00000100:00100000:0.0:1787393189.836672:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de801370840 going to sleep for 11 seconds 00000100:00100000:1.0:1787393189.846389:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82c8d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338475392:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393189.846418:0:10433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ce9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393189.848261:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393189.848335:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319595776 00000100:00100000:2.0:1787393189.848345:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319595776 00010000:00010000:2.0:1787393189.848381:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1caa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d82c expref: 6 pid: 5821 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393189.848432:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:2.0:1787393189.848442:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:2356:x1874217319595776:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393189.848457:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393189.848463:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1caa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d82c expref: 6 pid: 5821 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393189.848484:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1caa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d82c expref: 6 pid: 5821 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393189.848505:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1caa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d82c expref: 6 pid: 5821 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393189.848518:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54c00) 00010000:00010000:2.0:1787393189.848523:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ce9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393189.848532:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ce9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393189.848540:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ce9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393189.848564:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393189.848612:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2356:x1874217319595776:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 171us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393189.848619:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 61 00010000:00010000:0.0:1787393189.851033:0:10433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ce9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393189.851058:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ce9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393189.851089:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1cf0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393189.851112:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393189.851122:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393189.852638:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787393189.852655:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ce9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393189.852665:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ce9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393189.852672:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ce9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393189.852679:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761de00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393189.852684:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ce9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393189.852691:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ce9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393189.852705:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de81aa54c00) 00010000:00010000:0.0:1787393189.852708:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393189.852712:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ce9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393189.852719:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ce9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787393189.852750:0:10433:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b7fd3191 reply state 00000000ff6dd5a4 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393189.852759:0:10433:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787393189.854614:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:11320:x1874217319595648:12345-192.168.203.21@tcp:36:lfs.0 Request processed in 18483us (21512us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787393189.854625:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 140 00010000:00010000:2.0:1787393189.865209:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393189.865236:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1cf0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393189.865244:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1cf0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393189.865251:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761d600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393189.865256:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1cf0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393189.865264:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1cf0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393189.865280:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9de803da2100) 00010000:00010000:2.0:1787393189.865283:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393189.865287:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1cf0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393189.865293:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1cf0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393189.986564:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393189.986681:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319595904 00000100:00100000:1.0:1787393189.986692:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319595904 00000100:00100000:1.0:1787393189.986758:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 141 00000100:00100000:1.0:1787393189.986768:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:11328:x1874217319595904:12345-192.168.203.21@tcp:101:lctl.0 00010000:00010000:1.0:1787393189.986794:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393189.986818:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1cf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d841 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393189.986927:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1cfe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393189.986956:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1cfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393189.986966:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1cfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393189.987031:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787393189.987035:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393189.987060:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1cfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393189.987085:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1cf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d841 expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393189.987102:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1cfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d841 expref: 14 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393189.987112:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de80398f500) 00010000:00010000:1.0:1787393189.987115:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787393189.987119:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385ae00, rc 0) 00000100:00100000:1.0:1787393189.987194:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:11328:x1874217319595904:12345-192.168.203.21@tcp:101:lctl.0 Request processed in 427us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393189.987202:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 141 00000100:00100000:0.0:1787393190.060292:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393190.063310:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319596032 00000100:00100000:3.0:1787393190.063333:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319596032 00000100:00100000:3.0:1787393190.063437:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 142 00000100:00100000:3.0:1787393190.063450:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82c8d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+14:11334:x1874217319596032:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1787393190.063479:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393190.063506:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1d05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d848 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.063597:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1d0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.063615:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1d0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.063628:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1d0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.063644:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1d13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.063652:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1d13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.063679:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1d13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.065876:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1d1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.065899:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.065912:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393190.065993:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787393190.065997:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787393190.066020:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.066035:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1d0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.066042:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1d0c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.066050:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1d0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.066057:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393190.066063:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1d0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.066072:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1d0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.066099:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de80398f500) 00010000:00010000:3.0:1787393190.066103:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393190.066107:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1d0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.066113:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1d0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.066130:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1d13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.066136:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1d13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.066154:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1d13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.066160:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393190.066270:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1d13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.066285:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1d13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.066295:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9de8063da400) 00010000:00010000:3.0:1787393190.066297:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393190.066300:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1d13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.066307:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1d13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.066441:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1d05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d848 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.066455:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1d1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d848 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.066463:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:3.0:1787393190.066465:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787393190.066468:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531c00, rc 0) 00000100:00100000:3.0:1787393190.066642:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82c8d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:11334:x1874217319596032:12345-192.168.203.21@tcp:101:bash.0 Request processed in 3194us (6363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393190.066667:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 142 00000100:00100000:3.0:1787393190.074191:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393190.075173:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319596288 00000100:00100000:2.0:1787393190.075185:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319596288 00000100:00100000:2.0:1787393190.075250:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 143 00000100:00100000:2.0:1787393190.075260:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+15:11334:x1874217319596288:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1787393190.075281:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393190.075301:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1d21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d84f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.075466:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1d28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.075480:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1d28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.075491:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1d28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.075621:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1d2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.075630:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.075637:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787393190.076245:0:5820:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787393190.076410:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1d36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.076421:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1d36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.076429:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1d36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.076461:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1d28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.076478:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1d28 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.076484:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1d28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.076490:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393190.076495:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1d28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.076503:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1d28 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.082493:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:2.0:1787393190.082503:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393190.082511:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1d28 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.082757:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f1d28 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787393190.082784:0:5820:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007de2c9c4 reply state 000000001c647e94 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393190.082793:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787393190.083269:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1d21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d84f expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.083287:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1d36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d84f expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.083316:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8b00) 00010000:00010000:2.0:1787393190.083318:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787393190.083321:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4e00, rc 0) 00000100:00100000:2.0:1787393190.083415:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+18:11334:x1874217319596288:12345-192.168.203.21@tcp:101:bash.0 Request processed in 8154us (9231us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787393190.083425:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 143 00010000:00010000:0.0:1787393190.089170:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.089189:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1d2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.089197:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1d2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.089204:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393190.089209:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1d2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.089217:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1d2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.089235:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de818bd8d00) 00010000:00010000:0.0:1787393190.089238:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393190.089242:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1d2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.089248:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1d2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393190.091033:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393190.091153:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319596416 00000100:00100000:2.0:1787393190.091164:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319596416 00000100:00100000:2.0:1787393190.091223:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:2.0:1787393190.091234:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2355:x1874217319596416:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1787393190.091252:0:7525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393190.091271:0:7525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000460d47f/0x19a927d9c62f1d44 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d856 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787393190.091302:0:7525:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787393190.091322:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1787393190.091327:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787393190.091337:0:7525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000460d47f/0x19a927d9c62f1d44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d856 expref: 6 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787393190.091429:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787393190.091466:0:7525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000460d47f/0x19a927d9c62f1d44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d856 expref: 6 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.091481:0:7525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5600, rc 0) 00000100:00100000:2.0:1787393190.091548:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319596416:12345-192.168.203.21@tcp:101:bash.0 Request processed in 316us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393190.091567:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:2.0:1787393190.096389:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393190.096490:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319596544 00000100:00100000:3.0:1787393190.096502:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319596544 00000100:00100000:3.0:1787393190.096597:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:3.0:1787393190.096608:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:11334:x1874217319596544:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1787393190.096626:0:6625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393190.096653:0:6625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fecd5b7/0x19a927d9c62f1d4b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d85d expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.096684:0:6625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000460d47f/0x19a927d9c62f1d44 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d856 expref: 7 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.096692:0:6625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393190.096709:0:6625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393190.096715:0:6625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fecd5b7/0x19a927d9c62f1d4b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d85d expref: 7 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.096749:0:6625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000460d47f/0x19a927d9c62f1d44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d856 expref: 7 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.096763:0:6625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000460d47f/0x19a927d9c62f1d44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d856 expref: 7 pid: 7525 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393190.096777:0:6625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de80ba1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6625:1874217338475520:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393190.096900:0:6625:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787393190.102741:0:6625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de80ba1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6625:1874217338475520:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393190.102777:0:6625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005fecd5b7/0x19a927d9c62f1d4b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d85d expref: 7 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.102797:0:6625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531600, rc 0) 00000100:00100000:3.0:1787393190.102882:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:11334:x1874217319596544:12345-192.168.203.21@tcp:101:bash.0 Request processed in 6274us (6502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393190.102891:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:2.0:1787393190.105210:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393190.105305:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319596672 00000100:00100000:1.0:1787393190.105315:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319596672 00010000:00010000:1.0:1787393190.105356:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000460d47f/0x19a927d9c62f1d44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d856 expref: 7 pid: 7525 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393190.105416:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00100000:1.0:1787393190.105426:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2354:x1874217319596672:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393190.105441:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393190.105476:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000460d47f/0x19a927d9c62f1d44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d856 expref: 7 pid: 7525 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.105490:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000460d47f/0x19a927d9c62f1d44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d856 expref: 7 pid: 7525 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.105514:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000460d47f/0x19a927d9c62f1d44 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d856 expref: 7 pid: 7525 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.105530:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393190.105535:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393190.105543:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005fecd5b7/0x19a927d9c62f1d4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d85d expref: 6 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.105554:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fecd5b7/0x19a927d9c62f1d4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d85d expref: 6 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.105592:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005fecd5b7/0x19a927d9c62f1d4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d85d expref: 6 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393190.105607:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ece680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5807:1874217338475648:192.168.203.21@tcp:105: 00000100:00100000:1.0:1787393190.105701:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8012549c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393190.110285:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ece680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5807:1874217338475648:192.168.203.21@tcp:105: 00010000:00010000:1.0:1787393190.110311:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393190.110606:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2354:x1874217319596672:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 5180us (5404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393190.110617:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00100000:0.0:1787393190.114158:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393190.114268:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319596928 00000100:00100000:1.0:1787393190.114278:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319596928 00000100:00100000:1.0:1787393190.114328:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:1.0:1787393190.114338:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+17:11334:x1874217319596928:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:1.0:1787393190.114699:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+18:11334:x1874217319596928:12345-192.168.203.21@tcp:35:bash.0 Request processed in 361us (548us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787393190.114707:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:2.0:1787393190.191416:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393190.191503:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319597184 00000100:00100000:0.0:1787393190.191514:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319597184 00000100:00100000:0.0:1787393190.191572:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 144 00000100:00100000:0.0:1787393190.191583:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+18:11344:x1874217319597184:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1787393190.191606:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393190.191625:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1d52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d864 expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393190.191740:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787393190.191911:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1d52 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d864 expref: 20 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.191940:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de80398f500) 00010000:00010000:0.0:1787393190.191943:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787393190.191947:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1d52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d864 expref: 20 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.191961:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761d600, rc 0) 00000100:00100000:0.0:1787393190.192165:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:11344:x1874217319597184:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 583us (758us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787393190.192173:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 144 00000100:00100000:0.0:1787393190.199890:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393190.199996:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319597440 00000100:00100000:1.0:1787393190.200006:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319597440 00000100:00100000:1.0:1787393190.200061:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:1.0:1787393190.200072:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:11344:x1874217319597440:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1787393190.200348:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:11344:x1874217319597440:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 276us (467us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1787393190.200356:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:3.0:1787393190.249914:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338475776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787393190.250006:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393190.251083:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338475776 00000100:00100000:2.0:1787393190.251095:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338475776 00000100:00100000:2.0:1787393190.251154:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787393190.251164:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338475776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787393190.251197:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393190.251264:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338475776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393190.251271:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787393190.251452:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338475776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787393190.265044:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393190.265322:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319597568 00000100:00100000:1.0:1787393190.265333:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319597568 00000100:00100000:1.0:1787393190.265394:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 145 00000100:00100000:1.0:1787393190.265404:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:11350:x1874217319597568:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393190.265429:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393190.265459:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1d60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d86b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.265526:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f1d67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.265539:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f1d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.265550:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f1d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393190.265622:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787393190.265625:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393190.265648:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f1d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.265674:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1d60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d86b expref: 22 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.265691:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f1d67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d86b expref: 21 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.265700:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:1.0:1787393190.265703:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787393190.265706:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385be00, rc 0) 00000100:00100000:1.0:1787393190.266232:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:11350:x1874217319597568:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 827us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393190.266239:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 145 00000100:00100000:2.0:1787393190.277432:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393190.277534:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319597824 00000100:00100000:3.0:1787393190.277544:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319597824 00000100:00100000:3.0:1787393190.277619:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 146 00000100:00100000:3.0:1787393190.277629:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:11350:x1874217319597824:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1787393190.277649:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393190.277669:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1d6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d872 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.277779:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1d75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.277940:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.277955:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393190.277967:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787393190.278092:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1d6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d872 expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.279400:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1d75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d872 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.279415:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8b00) 00010000:00010000:3.0:1787393190.279418:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787393190.279421:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530400, rc 0) 00000100:00100000:3.0:1787393190.279484:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:11350:x1874217319597824:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1857us (2062us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1787393190.279493:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 146 00000100:00100000:0.0:1787393190.282518:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393190.282663:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393190.283313:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319598208 00000100:00100000:3.0:1787393190.283332:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319598208 00000100:00100000:3.0:1787393190.283391:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 147 00000100:00100000:3.0:1787393190.283401:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:11350:x1874217319598208:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1787393190.283422:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393190.283441:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1d83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d879 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.283528:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1d8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.283542:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1d8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.283553:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1d8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393190.283565:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787393190.283677:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1d83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d879 expref: 26 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.283696:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1d8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d879 expref: 25 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.283705:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8b00) 00010000:00010000:3.0:1787393190.283708:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787393190.283711:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530600, rc 0) 00000100:00100000:3.0:1787393190.283760:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+25:11350:x1874217319598208:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 361us (1097us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787393190.283766:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 147 00000100:00100000:2.0:1787393190.285644:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319597952 00000100:00100000:2.0:1787393190.285658:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319597952 00000100:00100000:2.0:1787393190.285728:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:2.0:1787393190.285738:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+25:2355:x1874217319597952:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393190.285753:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393190.285778:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1d75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d872 expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.285810:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8b00) 00010000:00010000:2.0:1787393190.285815:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393190.285879:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+24:2355:x1874217319597952:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 143us (3383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393190.285903:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:0.0:1787393190.291489:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393190.291563:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319598336 00000100:00100000:3.0:1787393190.291573:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319598336 00000100:00100000:3.0:1787393190.291628:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:3.0:1787393190.291638:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2354:x1874217319598336:12345-192.168.203.21@tcp:1:lfs.0 00010000:00010000:3.0:1787393190.291684:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1d98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.291702:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005fecd5b7/0x19a927d9c62f1d4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d85d expref: 6 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.291709:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393190.291713:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787393190.291717:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1d98 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.291748:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005fecd5b7/0x19a927d9c62f1d4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d85d expref: 6 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.291763:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005fecd5b7/0x19a927d9c62f1d4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d85d expref: 6 pid: 6625 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393190.291777:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de80ba18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6624:1874217338475904:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393190.291899:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787393190.295542:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393190.295624:0:6629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319598464 00000100:00100000:2.0:1787393190.295634:0:6629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319598464 00002000:00100000:2.0:1787393190.295688:0:6629:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9de83caa4000 x1874217319598464/t0(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:161/0 lens 504/0 e 0 to 0 dl 1787393201 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787393190.295698:0:6629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de83caa4000 with x1874217319598464 ext(0->12) 00010000:00010000:2.0:1787393190.295706:0:6629:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005fecd5b7/0x19a927d9c62f1d4b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d85d expref: 7 pid: 6625 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.295722:0:6629:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005fecd5b7/0x19a927d9c62f1d4b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d85d expref: 7 pid: 6625 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787393190.295730:0:6629:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9de83caa4000 00000100:00100000:2.0:1787393190.295760:0:6629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:2.0:1787393190.295769:0:6629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2356:x1874217319598464:12345-192.168.203.21@tcp:4:lfs.0 00000100:00100000:2.0:1787393190.296417:0:6629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:2356:x1874217319598464:12345-192.168.203.21@tcp:4:lfs.0 Request processed in 646us (881us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787393190.296425:0:6629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 2 00002000:00100000:2.0:1787393190.296432:0:6629:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9de83caa4000 x1874217319598464/t4294967305(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:161/0 lens 504/448 e 0 to 0 dl 1787393201 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787393190.296439:0:6629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de83caa4000 with x1874217319598464 ext(0->12) 00010000:00010000:2.0:1787393190.296445:0:6629:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005fecd5b7/0x19a927d9c62f1d4b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d85d expref: 9 pid: 6625 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.296468:0:6629:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005fecd5b7/0x19a927d9c62f1d4b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d85d expref: 9 pid: 6625 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787393190.296475:0:6629:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9de83caa4000 00000100:00100000:3.0:1787393190.296585:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de80ba18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6624:1874217338475904:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393190.296607:0:6624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1d98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393190.299836:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393190.299955:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319598592 00000100:00100000:1.0:1787393190.299977:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319598592 00010000:00010000:1.0:1787393190.300011:0:11945:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005fecd5b7/0x19a927d9c62f1d4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d85d expref: 9 pid: 6625 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393190.300060:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:1.0:1787393190.300070:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:2353:x1874217319598592:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393190.300083:0:11945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787393190.300101:0:11945:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787393190.300104:0:11945:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787393190 00002000:00010000:1.0:1787393190.300106:0:11945:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787393190 00002000:00010000:1.0:1787393190.300108:0:11945:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787393190 00010000:00010000:1.0:1787393190.300114:0:11945:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005fecd5b7/0x19a927d9c62f1d4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d85d expref: 9 pid: 6625 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.300127:0:11945:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005fecd5b7/0x19a927d9c62f1d4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d85d expref: 9 pid: 6625 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.300151:0:11945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fecd5b7/0x19a927d9c62f1d4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d85d expref: 9 pid: 6625 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.300168:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787393190.300172:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787393190.300177:0:11945:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1d98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.300187:0:11945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1d98 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.300231:0:11945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393190.300285:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2353:x1874217319598592:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 216us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393190.300293:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 63 00010000:00010000:2.0:1787393190.300900:0:6624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1d98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.300912:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1d98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.300947:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1d98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.300955:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1d98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.300963:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1d98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.300970:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531a00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393190.300974:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1d98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.300983:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1d98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.301009:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1d98 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.301016:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fc931d0/0x19a927d9c62f1d98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393190.301078:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2354:x1874217319598336:12345-192.168.203.21@tcp:1:lfs.0 Request processed in 9441us (9598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393190.301085:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:0.0:1787393190.303995:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393190.304182:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319598848 00000100:00100000:1.0:1787393190.304192:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319598848 00000100:00100000:1.0:1787393190.304247:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00100000:1.0:1787393190.304256:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818e24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+24:11350:x1874217319598848:12345-192.168.203.21@tcp:35:lfs.0 00000004:00010000:1.0:1787393190.304329:0:5823:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1d8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d879 expref: 24 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787393190.305283:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1787393190.305449:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1787393190.306428:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1787393190.306492:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1d9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.306510:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1d36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d84f expref: 28 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.306517:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1d9f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.306551:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1d36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d84f expref: 28 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.306565:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1d36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d84f expref: 28 pid: 5820 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393190.306587:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834ece680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5823:1874217338476032:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393190.306719:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de801254a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787393190.313893:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393190.313992:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319598976 00000100:00100000:3.0:1787393190.314002:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319598976 00010000:00010000:3.0:1787393190.314040:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1d36 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d84f expref: 29 pid: 5820 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393190.314091:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:3.0:1787393190.314101:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de826cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+29:2356:x1874217319598976:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787393190.314116:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393190.314122:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1d36 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d84f expref: 29 pid: 5820 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.314134:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1d36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d84f expref: 29 pid: 5820 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.314166:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8b00) 00010000:00010000:3.0:1787393190.314172:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1d9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.314181:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.314187:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1d9f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.314204:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393190.314258:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de826cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+29:2356:x1874217319598976:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 158us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393190.314291:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 64 00010000:00010000:0.0:1787393190.314734:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f1d36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d84f expref: 28 pid: 5820 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393190.314749:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834ece680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5823:1874217338476032:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787393190.314768:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.314776:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.314781:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787393190.314953:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787393190.315553:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1787393190.315685:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83caa5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1874217338476160:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787393190.315734:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393190.315805:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351c2900 going to sleep for 11 seconds 00000100:00100000:1.0:1787393190.316365:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338476160 00000100:00100000:1.0:1787393190.316373:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338476160 00000100:00100000:1.0:1787393190.316463:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787393190.316474:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1874217338476160:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787393190.316568:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1874217338476160:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 95us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393190.316575:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787393190.316641:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83caa5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1874217338476160:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787393190.317185:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1787393190.317253:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83caa5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1874217338476288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787393190.317303:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393190.319825:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351c29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787393190.319949:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338476288 00000100:00100000:3.0:1787393190.319957:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338476288 00000100:00100000:3.0:1787393190.320008:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787393190.320018:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5823:x1874217338476288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787393190.320534:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5823:x1874217338476288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 516us (3228us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787393190.320543:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787393190.324736:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83caa5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1874217338476288:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787393190.324870:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1787393190.324946:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.324958:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1d9f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.324966:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1d9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.324972:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385b000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393190.324976:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1d9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.324984:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1d9f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.324999:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8b00) 00010000:00010000:0.0:1787393190.325002:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787393190.325006:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1d9f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.325013:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1d9f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787393190.325382:0:5823:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787393190.325492:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1787393190.325503:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339500663332ns, next at 340500661158ns, rc = 0 00000001:00080000:0.0:1787393190.325511:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1787393190.325546:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8b00) 00010000:00010000:0.0:1787393190.325549:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787393190.325562:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1d8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d879 expref: 32 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393190.325738:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818e24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+31:11350:x1874217319598848:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 21481us (21749us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1787393190.325748:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 38 00000020:00080000:0.0:1787393190.325755:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787393190.338734:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393190.338976:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319599104 00000100:00100000:1.0:1787393190.338987:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319599104 00000100:00100000:0.0:1787393190.339766:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 148 00000100:00100000:0.0:1787393190.339778:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+31:11350:x1874217319599104:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1787393190.339802:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393190.339825:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f1da6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d880 expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.339929:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f1da6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d880 expref: 32 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.339943:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f1da6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d880 expref: 32 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.339963:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:0.0:1787393190.339967:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787393190.339970:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761c800, rc 0) 00000100:00100000:0.0:1787393190.340038:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+32:11350:x1874217319599104:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 262us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393190.340045:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 148 00000100:00100000:0.0:1787393190.345427:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393190.346207:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319599360 00000100:00100000:3.0:1787393190.346219:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319599360 00000100:00100000:3.0:1787393190.346308:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:3.0:1787393190.346328:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+32:11350:x1874217319599360:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:3.0:1787393190.346625:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+33:11350:x1874217319599360:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 297us (1207us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1787393190.346633:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 39 00010000:00010000:3.0:1787393190.376033:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393190.435824:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393190.435971:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319599616 00000100:00100000:3.0:1787393190.435980:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319599616 00000100:00100000:3.0:1787393190.436042:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 149 00000100:00100000:3.0:1787393190.436057:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+33:11360:x1874217319599616:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1787393190.436079:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393190.436097:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1dad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d887 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393190.436215:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787393190.436321:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1dad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d887 expref: 35 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.436346:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de80398f500) 00010000:00010000:3.0:1787393190.436348:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787393190.436354:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1dad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d887 expref: 35 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.436368:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530200, rc 0) 00000100:00100000:3.0:1787393190.436422:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+34:11360:x1874217319599616:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 367us (608us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1787393190.436429:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 149 00000100:00100000:2.0:1787393190.442887:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393190.442980:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319599744 00000100:00100000:3.0:1787393190.442990:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319599744 00000100:00100000:3.0:1787393190.443057:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 150 00000100:00100000:3.0:1787393190.443067:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+34:11360:x1874217319599744:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:3.0:1787393190.443143:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1dbb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443171:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1dbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443184:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1dbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443199:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1dc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443206:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443231:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443576:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1dc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443586:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443594:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787393190.443636:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443649:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1dbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443656:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1dbb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443662:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1dbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443669:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393190.443673:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1dbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443680:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1dbb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443693:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:3.0:1787393190.443702:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393190.443706:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1dbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443713:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1dbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443727:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443733:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1dc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443740:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443745:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393190.443749:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443755:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1dc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443762:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de8063da400) 00010000:00010000:3.0:1787393190.443764:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393190.443767:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1dc2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443773:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1dc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443786:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443798:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1dc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443804:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443809:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393190.443812:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443818:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1dc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443826:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:3.0:1787393190.443828:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393190.443831:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1dc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.443836:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1dc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393190.443970:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+34:11360:x1874217319599744:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 903us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393190.443979:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 150 00000100:00100000:0.0:1787393190.446682:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393190.446774:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319600000 00000100:00100000:1.0:1787393190.446783:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319600000 00000100:00100000:1.0:1787393190.446871:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 40 00000100:00100000:1.0:1787393190.446882:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+34:11360:x1874217319600000:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1787393190.447158:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+35:11360:x1874217319600000:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 277us (484us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1787393190.447167:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 40 00000100:00100000:0.0:1787393190.503507:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393190.503645:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319600256 00000100:00100000:1.0:1787393190.503655:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319600256 00000100:00100000:1.0:1787393190.503716:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 151 00000100:00100000:1.0:1787393190.503727:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+35:11363:x1874217319600256:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393190.503752:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393190.503782:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1dd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d88e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.503912:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1dd7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.503938:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.503950:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.503966:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1dde lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.503973:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.503979:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504134:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f1de5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504143:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f1de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504149:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f1de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393190.504158:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787393190.504244:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504260:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1dd7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504266:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504272:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393190.504277:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504283:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1dd7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504295:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:1.0:1787393190.504297:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393190.504301:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1dd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504307:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f1dd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504319:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504325:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1dde lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504330:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1dde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504334:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393190.504342:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1dde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504347:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1dde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504355:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de80398f400) 00010000:00010000:1.0:1787393190.504357:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393190.504360:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1dde lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504365:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f1dde lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504401:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f1dd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d88e expref: 38 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504415:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f1de5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d88e expref: 37 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.504422:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:1.0:1787393190.504424:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393190.504632:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385a200, rc 0) 00000100:00100000:1.0:1787393190.504696:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+37:11363:x1874217319600256:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 969us (1197us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1787393190.504704:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 151 00000100:00100000:2.0:1787393190.509733:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393190.510771:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319600384 00000100:00100000:0.0:1787393190.510798:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319600384 00000100:00100000:0.0:1787393190.510889:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 152 00000100:00100000:0.0:1787393190.510900:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+37:11363:x1874217319600384:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:0.0:1787393190.510974:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1df3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.510990:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1df3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.511001:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1df3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.511024:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1df3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.511030:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1df3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.511046:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1df3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.511052:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761ca00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393190.511056:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1df3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.511062:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1df3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.511078:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:0.0:1787393190.511092:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787393190.511097:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1df3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.511103:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1df3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393190.511179:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+37:11363:x1874217319600384:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 280us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393190.511194:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 152 00000100:00100000:0.0:1787393190.524179:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393190.524326:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319600640 00000100:00100000:1.0:1787393190.524337:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319600640 00000100:00100000:1.0:1787393190.524389:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00100000:1.0:1787393190.524400:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+37:11363:x1874217319600640:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1787393190.524871:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+38:11363:x1874217319600640:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 441us (670us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787393190.524880:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00100000:1.0:1787393190.865336:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393190.865426:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319600896 00000100:00100000:3.0:1787393190.865437:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319600896 00000100:00100000:3.0:1787393190.865493:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 153 00000100:00100000:3.0:1787393190.865503:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+38:11394:x1874217319600896:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:3.0:1787393190.865539:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393190.865570:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1dfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d895 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.865669:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1e01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.865684:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.865710:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393190.865721:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787393190.865882:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1dfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d895 expref: 41 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.865902:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d895 expref: 40 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.865921:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:3.0:1787393190.865925:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787393190.865928:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530600, rc 0) 00000100:00100000:3.0:1787393190.865992:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+40:11394:x1874217319600896:12345-192.168.203.21@tcp:101:cat.0 Request processed in 489us (683us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787393190.866001:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 153 00000100:00100000:2.0:1787393190.885070:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393190.885170:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393190.885344:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319601024 00000100:00100000:1.0:1787393190.885355:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319601024 00000100:00100000:1.0:1787393190.885423:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:1.0:1787393190.885434:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+40:2356:x1874217319601024:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393190.885450:0:11945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393190.885474:0:11945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1e01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d895 expref: 40 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.885493:0:11945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:1.0:1787393190.885498:0:11945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393190.885565:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+39:2356:x1874217319601024:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 133us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393190.885573:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:3.0:1787393190.886081:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319601280 00000100:00100000:3.0:1787393190.886087:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319601280 00000100:00100000:3.0:1787393190.886121:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:3.0:1787393190.886130:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+39:11394:x1874217319601280:12345-192.168.203.21@tcp:35:cat.0 00000100:00100000:3.0:1787393190.886441:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+40:11394:x1874217319601280:12345-192.168.203.21@tcp:35:cat.0 Request processed in 311us (1270us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787393190.886449:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:2.0:1787393190.978956:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393190.979133:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319601536 00000100:00100000:0.0:1787393190.979143:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319601536 00000100:00100000:0.0:1787393190.979194:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 154 00000100:00100000:0.0:1787393190.979203:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+40:11400:x1874217319601536:12345-192.168.203.21@tcp:101:dd.0 00010000:00010000:0.0:1787393190.979225:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393190.979228:0:10433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787393190.979251:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f1d67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d86b expref: 40 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.979269:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:0.0:1787393190.979273:0:10433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787393190.979286:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1e0f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d89c expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.979381:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1e16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.979393:0:10433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f1de5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d88e expref: 40 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.979414:0:10433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1e16 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.979446:0:10433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f1de5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d88e expref: 40 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393190.979459:0:10433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f1de5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d88e expref: 40 pid: 5821 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393190.979473:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83caa5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338476416:192.168.203.21@tcp:104: 00000100:00100000:0.0:1787393190.979572:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351c2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787393190.981982:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83caa5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338476416:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393190.982009:0:10433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1e16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393190.982793:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393190.982906:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319601664 00000100:00100000:3.0:1787393190.982925:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319601664 00010000:00010000:3.0:1787393190.983011:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f1de5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d88e expref: 41 pid: 5821 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393190.983056:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:3.0:1787393190.983066:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+41:2356:x1874217319601664:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787393190.983079:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393190.983086:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f1de5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d88e expref: 41 pid: 5821 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.983100:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f1de5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d88e expref: 41 pid: 5821 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.983123:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f1de5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d88e expref: 41 pid: 5821 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.983147:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:3.0:1787393190.983153:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1e16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.983162:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1e16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.983169:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1e16 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.983220:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787393190.983252:0:10433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1e16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.983262:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1e16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393190.983280:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+40:2356:x1874217319601664:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 214us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393190.983290:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 65 00000004:00200000:1.0:1787393190.983293:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787393190.983446:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1e0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d89c expref: 41 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.983462:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1e16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d89c expref: 40 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393190.983470:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:1.0:1787393190.983473:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787393190.983475:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761c200, rc 0) 00000100:00100000:1.0:1787393190.983499:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+40:11400:x1874217319601536:12345-192.168.203.21@tcp:101:dd.0 Request processed in 4297us (4553us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787393190.983505:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 154 00000100:00100000:0.0:1787393190.987037:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393190.988016:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319601920 00000100:00100000:3.0:1787393190.988027:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319601920 00000100:00100000:3.0:1787393190.988183:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 155 00000100:00100000:3.0:1787393190.988194:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+40:11400:x1874217319601920:12345-192.168.203.21@tcp:36:dd.0 00010000:00010000:3.0:1787393190.988477:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.988493:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393190.988504:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787393190.988553:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1787393190.988580:0:5820:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000551c24e4 reply state 000000003f2ba3c6 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393190.988588:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787393190.988684:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+43:11400:x1874217319601920:12345-192.168.203.21@tcp:36:dd.0 Request processed in 492us (1654us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1787393190.988692:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 155 00000020:00080000:3.0:1787393190.988698:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787393190.996789:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.996806:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.996814:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.996819:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393190.996824:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.997054:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.997072:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:2.0:1787393190.997075:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393190.997080:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393190.997087:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787393191.144119:0:11566:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787393191.144130:0:11566:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787393191.144363:0:11566:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787393191.144383:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787393191.315186:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393191.315286:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319602048 00000100:00100000:3.0:1787393191.315296:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319602048 00000100:00100000:3.0:1787393191.315365:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 156 00000100:00100000:3.0:1787393191.315375:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+42:11415:x1874217319602048:12345-192.168.203.21@tcp:101:stat.0 00010000:00010000:3.0:1787393191.315397:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393191.315417:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1e2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d8a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.315483:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1e32 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.315496:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1e32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.315507:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1e32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.315522:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1e39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.315529:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.315536:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.315648:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.315660:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1e16 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d89c expref: 43 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.315697:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e40 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.315731:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1e16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d89c expref: 43 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.315745:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1e16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d89c expref: 43 pid: 10433 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393191.315759:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de80ba18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1874217338476544:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393191.315889:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1b40 going to sleep for 11 seconds 00000100:00080000:0.0:1787393191.315948:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393191.321503:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393191.322881:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319602304 00000100:00100000:1.0:1787393191.322895:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319602304 00000100:00100000:1.0:1787393191.322973:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:1.0:1787393191.322984:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+44:5566:x1874217319602304:12345-192.168.203.21@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787393191.323748:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+45:5566:x1874217319602304:12345-192.168.203.21@tcp:35:ldlm_bl.0 Request processed in 762us (2250us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1787393191.323758:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:3.0:1787393191.323971:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de80ba18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1874217338476544:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393191.323996:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393191.329997:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393191.331272:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319602432 00000100:00100000:1.0:1787393191.331285:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319602432 00010000:00010000:1.0:1787393191.331330:0:11945:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1e16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d89c expref: 45 pid: 10433 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393191.331427:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 66 00000100:00100000:1.0:1787393191.331452:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+45:2356:x1874217319602432:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393191.331467:0:11945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393191.331474:0:11945:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1e16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d89c expref: 45 pid: 10433 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.331489:0:11945:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1e16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d89c expref: 45 pid: 10433 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.331526:0:11945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1e16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d89c expref: 45 pid: 10433 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.331545:0:11945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:1.0:1787393191.331549:0:11945:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.331559:0:11945:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.331566:0:11945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e40 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.331598:0:11945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393191.331660:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+44:2356:x1874217319602432:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 210us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393191.331669:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 66 00010000:00010000:3.0:1787393191.331730:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.331739:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393191.331797:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787393191.331801:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787393191.331821:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.331833:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.331874:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1e32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.331881:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1e32 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.331887:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1e32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.331893:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393191.331897:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1e32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.331904:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1e32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.331925:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:3.0:1787393191.331928:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393191.331932:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1e32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.331938:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1e32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.331949:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.331955:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1e39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.331961:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1e39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.331972:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393191.331975:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1e39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.331981:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1e39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.331989:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de8063da400) 00010000:00010000:3.0:1787393191.331992:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393191.331994:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1e39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.332000:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1e39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.332036:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1e2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8a3 expref: 44 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.333288:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8a3 expref: 43 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.333296:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:3.0:1787393191.333299:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787393191.333302:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531a00, rc 0) 00000100:00100000:0.0:1787393191.333446:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+43:11415:x1874217319602048:12345-192.168.203.21@tcp:101:stat.0 Request processed in 18070us (18267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393191.333455:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 156 00010000:00010000:0.0:1787393191.400016:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393191.409803:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393191.409938:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319602688 00000100:00100000:1.0:1787393191.409948:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319602688 00000100:00100000:1.0:1787393191.410009:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 157 00000100:00100000:1.0:1787393191.410019:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+43:11421:x1874217319602688:12345-192.168.203.21@tcp:36:truncate.0 00010000:00010000:1.0:1787393191.410091:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393191.410119:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1e40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8a3 expref: 43 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.410139:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:1.0:1787393191.410144:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787393191.410355:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1e47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.410379:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1e47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.410389:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1e47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787393191.410449:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1787393191.410476:0:5821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b5dc7f83 reply state 0000000086c57de8 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1e47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393191.410486:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787393191.410885:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+45:11421:x1874217319602688:12345-192.168.203.21@tcp:36:truncate.0 Request processed in 821us (1045us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787393191.410894:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 157 00000020:00080000:1.0:1787393191.410900:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787393191.415611:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1e47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.415627:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1e47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.415634:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1e47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.415651:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385b000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393191.415656:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1e47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.415663:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1e47 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.415679:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:0.0:1787393191.415682:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393191.415686:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1e47 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.415691:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1e47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393191.551716:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393191.553188:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319602816 00000100:00100000:1.0:1787393191.553201:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319602816 00000100:00100000:1.0:1787393191.553323:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 158 00000100:00100000:1.0:1787393191.553334:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+44:11435:x1874217319602816:12345-192.168.203.21@tcp:101:stat.0 00010000:00010000:1.0:1787393191.553369:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393191.553399:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1e4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d8aa expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553572:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1e55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553588:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1e55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553600:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1e55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553615:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553622:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553627:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553715:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1e63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553722:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553728:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393191.553760:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787393191.553763:0:10433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393191.553791:0:10433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553808:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553824:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1e55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553829:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1e55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553835:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1e55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553924:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393191.553928:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1e55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553943:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1e55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553955:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:1.0:1787393191.553958:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393191.553962:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1e55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553968:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1e55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553979:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553985:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.553996:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.554001:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393191.554004:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.554010:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.554017:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de80398fb00) 00010000:00010000:1.0:1787393191.554019:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393191.554021:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.554026:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.554306:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1e4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8aa expref: 46 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.554320:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8aa expref: 45 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.554328:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:1.0:1787393191.554330:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393191.554332:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385b400, rc 0) 00000100:00100000:1.0:1787393191.554672:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+45:11435:x1874217319602816:12345-192.168.203.21@tcp:101:stat.0 Request processed in 1338us (2963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393191.554689:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 158 00000100:00100000:3.0:1787393191.660407:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393191.660485:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319603072 00000100:00100000:1.0:1787393191.660497:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319603072 00000100:00100000:1.0:1787393191.660557:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 159 00000100:00100000:1.0:1787393191.660568:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+45:11445:x1874217319603072:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393191.660591:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393191.660614:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1e6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d8b1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393191.660733:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787393191.660897:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1e6a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8b1 expref: 47 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.660922:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de80398f500) 00010000:00010000:1.0:1787393191.660926:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787393191.660931:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1e6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8b1 expref: 47 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.660945:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385ba00, rc 0) 00000100:00100000:1.0:1787393191.661007:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+46:11445:x1874217319603072:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 441us (608us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1787393191.661014:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 159 00000100:00100000:0.0:1787393191.665730:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393191.665833:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319603328 00000100:00100000:1.0:1787393191.665863:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319603328 00000100:00100000:1.0:1787393191.665933:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 44 00000100:00100000:1.0:1787393191.665944:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818e25850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+46:11445:x1874217319603328:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1787393191.666339:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818e25850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+47:11445:x1874217319603328:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 396us (617us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787393191.666347:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 44 00000100:00100000:2.0:1787393191.744263:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393191.744413:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319603584 00000100:00100000:0.0:1787393191.744424:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319603584 00000100:00100000:0.0:1787393191.744484:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 160 00000100:00100000:0.0:1787393191.744495:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+47:11451:x1874217319603584:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:0.0:1787393191.744515:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393191.744534:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1e78 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d8b8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.744631:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1e7f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.744647:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1e63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8aa expref: 48 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.744673:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1e7f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.744708:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8aa expref: 48 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.744721:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1e63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8aa expref: 48 pid: 10433 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393191.744735:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83caa6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1874217338476672:192.168.203.21@tcp:104: 00000100:00100000:0.0:1787393191.745225:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351c2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787393191.752981:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393191.753453:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319603712 00000100:00100000:1.0:1787393191.753463:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319603712 00010000:00010000:1.0:1787393191.753502:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1e63 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8aa expref: 49 pid: 10433 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393191.753536:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 67 00000100:00100000:1.0:1787393191.753546:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+49:2356:x1874217319603712:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393191.753559:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393191.753565:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1e63 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8aa expref: 49 pid: 10433 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.753578:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1e63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8aa expref: 49 pid: 10433 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.753600:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:1.0:1787393191.753605:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1e7f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.753614:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1e7f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.753621:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1e7f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.753639:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393191.753714:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+49:2356:x1874217319603712:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 168us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393191.753724:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 67 00010000:00010000:0.0:1787393191.755063:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1e63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8aa expref: 48 pid: 10433 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393191.755087:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83caa6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1874217338476672:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787393191.755328:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1e7f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.755338:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1e7f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.755344:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1e7f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393191.755363:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787393191.755516:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1e78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8b8 expref: 49 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.755548:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1e7f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8b8 expref: 48 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.755558:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:0.0:1787393191.755561:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787393191.755564:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761de00, rc 0) 00000100:00100000:0.0:1787393191.755623:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+48:11451:x1874217319603584:12345-192.168.203.21@tcp:101:bash.0 Request processed in 11129us (11368us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787393191.755632:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 160 00000100:00100000:2.0:1787393191.764975:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393191.765110:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319603968 00000100:00100000:3.0:1787393191.765121:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319603968 00000100:00100000:3.0:1787393191.765187:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 161 00000100:00100000:3.0:1787393191.765197:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+48:11451:x1874217319603968:12345-192.168.203.21@tcp:36:bash.0 00010000:00010000:3.0:1787393191.765556:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1e8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.765573:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1e8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.765583:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1e8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787393191.765634:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1787393191.765933:0:5820:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ece8bff reply state 00000000d40b705e transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1e8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393191.765944:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787393191.766080:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+51:11451:x1874217319603968:12345-192.168.203.21@tcp:36:bash.0 Request processed in 883us (1112us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787393191.766088:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 161 00000020:00080000:3.0:1787393191.766094:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787393191.772797:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1e8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393191.772815:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1e8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393191.772823:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1e8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393191.772830:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393191.772835:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1e8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393191.772898:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1e8d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393191.772926:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:2.0:1787393191.772930:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393191.772934:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1e8d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393191.772942:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1e8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393191.774798:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393191.775536:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319604096 00000100:00100000:1.0:1787393191.775547:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319604096 00000100:00100000:1.0:1787393191.775609:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 162 00000100:00100000:1.0:1787393191.775619:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+50:11451:x1874217319604096:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:1.0:1787393191.775643:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393191.775672:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1e94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d8bf expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.775759:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.775775:0:10433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1e7f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8b8 expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.775784:0:10433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e9b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.777885:0:10433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1e7f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8b8 expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.777919:0:10433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1e7f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8b8 expref: 51 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393191.777938:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834daf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338476800:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393191.778039:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8012543c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787393191.784580:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393191.784675:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319604224 00000100:00100000:2.0:1787393191.784695:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319604224 00010000:00010000:2.0:1787393191.784733:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1e7f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8b8 expref: 52 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393191.784778:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:2.0:1787393191.784787:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+52:2356:x1874217319604224:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393191.784800:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393191.784806:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1e7f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8b8 expref: 52 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393191.784825:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1e7f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8b8 expref: 52 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393191.784879:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:2.0:1787393191.784885:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393191.784917:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393191.784925:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e9b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393191.784944:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393191.784996:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+52:2356:x1874217319604224:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 206us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393191.785005:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 68 00010000:00010000:1.0:1787393191.785631:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1e7f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8b8 expref: 51 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393191.785649:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834daf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338476800:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393191.785671:0:10433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.785688:0:10433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.785695:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393191.785739:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787393191.785743:0:10433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393191.785764:0:10433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.785795:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1e94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8bf expref: 51 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.785810:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8bf expref: 50 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.785818:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:1.0:1787393191.785821:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393191.785823:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385a800, rc 0) 00000100:00100000:1.0:1787393191.786024:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+50:11451:x1874217319604096:12345-192.168.203.21@tcp:101:bash.0 Request processed in 10407us (11235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393191.786032:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 162 00000100:00100000:3.0:1787393191.793708:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393191.793871:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319604480 00000100:00100000:1.0:1787393191.793880:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319604480 00000100:00100000:1.0:1787393191.793938:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:1.0:1787393191.793948:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+50:11451:x1874217319604480:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:1.0:1787393191.794182:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+51:11451:x1874217319604480:12345-192.168.203.21@tcp:35:bash.0 Request processed in 234us (480us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787393191.794191:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:2.0:1787393191.894758:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393191.894892:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319604736 00000100:00100000:1.0:1787393191.894903:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319604736 00000100:00100000:1.0:1787393191.894971:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 163 00000100:00100000:1.0:1787393191.894981:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+51:11461:x1874217319604736:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393191.895006:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393191.895030:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1ea2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d8c6 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393191.895155:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787393191.895271:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1ea2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8c6 expref: 53 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.895285:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de80398f500) 00010000:00010000:1.0:1787393191.895288:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787393191.895293:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1ea2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8c6 expref: 53 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.895305:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385ba00, rc 0) 00000100:00100000:1.0:1787393191.895370:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+52:11461:x1874217319604736:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 390us (621us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1787393191.895392:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 163 00000100:00100000:3.0:1787393191.899674:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393191.899773:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319604864 00000100:00100000:0.0:1787393191.899792:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319604864 00000100:00100000:0.0:1787393191.899887:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 164 00000100:00100000:0.0:1787393191.899898:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83d5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+52:11461:x1874217319604864:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:0.0:1787393191.899983:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1eb0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.899999:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1eb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900011:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1eb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900025:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1eb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900032:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900068:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900182:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ebe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900191:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900198:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787393191.900240:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900253:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1eb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900260:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1eb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900267:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1eb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900273:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761d600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393191.900277:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1eb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900284:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1eb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900297:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:0.0:1787393191.900307:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393191.900323:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1eb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900330:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1eb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900345:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900351:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1eb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900357:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900363:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761ca00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393191.900365:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900372:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1eb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900380:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de803da2b00) 00010000:00010000:0.0:1787393191.900382:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393191.900386:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1eb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900391:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1eb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900405:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900417:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ebe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900423:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ebe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900428:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761de00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393191.900431:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ebe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900437:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ebe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900445:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:0.0:1787393191.900448:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393191.900451:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ebe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393191.900456:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f1ebe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393191.900524:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83d5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+52:11461:x1874217319604864:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 627us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393191.900533:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 164 00000100:00100000:2.0:1787393191.903952:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393191.904132:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319605120 00000100:00100000:1.0:1787393191.904143:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319605120 00000100:00100000:1.0:1787393191.904191:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00100000:1.0:1787393191.904201:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+52:11461:x1874217319605120:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1787393191.904462:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+53:11461:x1874217319605120:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 261us (519us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1787393191.904470:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00100000:2.0:1787393191.979765:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393191.979861:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319605376 00000100:00100000:1.0:1787393191.979871:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319605376 00000100:00100000:1.0:1787393191.979931:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 165 00000100:00100000:1.0:1787393191.979941:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+53:11464:x1874217319605376:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393191.979963:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393191.979981:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1ec5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d8cd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980080:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1ecc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980093:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1ecc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980211:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1ecc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980228:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1ed3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980247:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980254:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980478:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1eda lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980487:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1eda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980494:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1eda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393191.980504:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787393191.980596:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1ecc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980603:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1ecc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980609:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1ecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980614:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393191.980618:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1ecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980624:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1ecc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980645:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:1.0:1787393191.980648:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393191.980652:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1ecc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980658:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1ecc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980671:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980676:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1ed3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980681:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980687:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385bc00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393191.980689:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980695:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1ed3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980702:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de80398fb00) 00010000:00010000:1.0:1787393191.980704:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393191.980706:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1ed3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980711:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1ed3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980762:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1ec5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8cd expref: 56 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980776:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1eda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8cd expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.980784:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:1.0:1787393191.980786:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393191.980788:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385b600, rc 0) 00000100:00100000:1.0:1787393191.981066:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:11464:x1874217319605376:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1125us (1307us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1787393191.981075:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 165 00000100:00100000:0.0:1787393191.985613:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393191.985653:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393191.985716:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319605632 00000100:00100000:3.0:1787393191.985726:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319605632 00000100:00100000:3.0:1787393191.985788:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:3.0:1787393191.985799:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:2355:x1874217319605632:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787393191.985813:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393191.985860:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b600/0x19a927d9c62f1eda lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8cd expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393191.985898:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:3.0:1787393191.985912:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393191.985960:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:2355:x1874217319605632:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 162us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393191.985968:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:1.0:1787393191.986201:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319605504 00000100:00100000:1.0:1787393191.986206:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319605504 00000100:00100000:1.0:1787393191.986234:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 166 00000100:00100000:1.0:1787393191.986241:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:11464:x1874217319605504:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:1.0:1787393191.986295:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1ee8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.986309:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.986593:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.986621:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.986641:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1ee8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.986648:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.986655:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385aa00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393191.986660:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.986668:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1ee8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.986678:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:1.0:1787393191.986681:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787393191.986685:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1ee8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393191.986690:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1ee8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393191.986742:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:11464:x1874217319605504:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 501us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393191.986750:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 166 00000100:00100000:0.0:1787393191.991193:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393191.991306:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319605888 00000100:00100000:1.0:1787393191.991326:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319605888 00000100:00100000:1.0:1787393191.991380:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:1.0:1787393191.991391:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:11464:x1874217319605888:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1787393191.991606:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:11464:x1874217319605888:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 216us (421us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787393191.991624:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:3.0:1787393192.208476:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393192.208752:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319606144 00000100:00100000:2.0:1787393192.208763:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319606144 00000100:00100000:2.0:1787393192.208834:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 167 00000100:00100000:2.0:1787393192.208862:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:11482:x1874217319606144:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:2.0:1787393192.208889:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393192.208921:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1eef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d8d4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393192.209027:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1ef6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393192.209237:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1ef6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393192.209249:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1ef6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393192.209279:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787393192.209589:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f1eef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8d4 expref: 58 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393192.209610:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1ef6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8d4 expref: 57 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393192.209620:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:2.0:1787393192.209623:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787393192.209627:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4200, rc 0) 00000100:00100000:2.0:1787393192.209699:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+57:11482:x1874217319606144:12345-192.168.203.21@tcp:101:cat.0 Request processed in 839us (1232us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787393192.209708:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 167 00000100:00100000:3.0:1787393192.247789:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393192.247967:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319606272 00000100:00100000:0.0:1787393192.247978:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319606272 00000100:00100000:0.0:1787393192.248081:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 168 00000100:00100000:0.0:1787393192.248103:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+57:11483:x1874217319606272:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1787393192.248128:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393192.248148:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1f04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d8db expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393192.248212:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1f0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393192.248225:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393192.248235:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393192.248294:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787393192.248297:0:10433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787393192.248317:0:10433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393192.248341:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761ca00/0x19a927d9c62f1f04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8db expref: 59 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393192.248359:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1f0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8db expref: 58 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393192.248367:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:0.0:1787393192.248370:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787393192.248373:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761d600, rc 0) 00000100:00100000:0.0:1787393192.248430:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+58:11483:x1874217319606272:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 328us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393192.248445:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 168 00000100:00100000:0.0:1787393192.268674:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393192.269006:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319606656 00000100:00100000:1.0:1787393192.269017:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319606656 00000100:00100000:1.0:1787393192.269172:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:1.0:1787393192.269182:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+58:11483:x1874217319606656:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1787393192.269561:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+59:11483:x1874217319606656:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 380us (894us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1787393192.269570:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:3.0:1787393192.272543:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393192.272644:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319606784 00000100:00100000:2.0:1787393192.272654:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319606784 00000100:00100000:2.0:1787393192.272720:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:2.0:1787393192.272730:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de826cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+59:11483:x1874217319606784:12345-192.168.203.21@tcp:103:lfs.0 00010000:00010000:2.0:1787393192.272747:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787393192.272770:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1e9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8bf expref: 59 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393192.272808:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f1ef6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8d4 expref: 58 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393192.272820:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f1da6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d880 expref: 57 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393192.272878:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de803da2e00) 00010000:00010000:2.0:1787393192.272890:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393192.272951:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de826cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+56:11483:x1874217319606784:12345-192.168.203.21@tcp:103:lfs.0 Request processed in 222us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393192.272958:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:3.0:1787393192.275702:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393192.276167:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319606912 00000100:00100000:2.0:1787393192.276176:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319606912 00000100:00100000:2.0:1787393192.276234:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 169 00000100:00100000:2.0:1787393192.276244:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+56:11483:x1874217319606912:12345-192.168.203.21@tcp:58:lfs.0 00010000:00010000:2.0:1787393192.276356:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1f12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393192.276372:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1f12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393192.276384:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1f12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787393192.276570:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787393192.276643:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+56:11483:x1874217319606912:12345-192.168.203.21@tcp:58:lfs.0 Request processed in 396us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393192.276652:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 169 00000100:00100000:2.0:1787393192.308769:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393192.308883:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319607040 00000100:00100000:1.0:1787393192.308892:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319607040 00000100:00100000:1.0:1787393192.308945:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 170 00000100:00100000:1.0:1787393192.308954:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+56:11485:x1874217319607040:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393192.308972:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393192.308990:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d8e2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309057:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1f20 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309071:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1f20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309082:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1f20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309097:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309119:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309126:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309213:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1f2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309220:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309227:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393192.309260:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787393192.309264:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393192.309280:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309290:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309298:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1f20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309304:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1f20 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309311:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1f20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309326:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385ba00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393192.309339:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1f20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309347:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1f20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309360:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:1.0:1787393192.309363:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393192.309367:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1f20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309373:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ba00/0x19a927d9c62f1f20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309385:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309391:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309397:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309401:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385bc00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393192.309404:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309409:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309424:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de80398fb00) 00010000:00010000:1.0:1787393192.309427:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393192.309429:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309434:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309461:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8e2 expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309472:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1f2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8e2 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393192.309478:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8200) 00010000:00010000:1.0:1787393192.309480:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787393192.309483:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385a400, rc 0) 00000100:00100000:1.0:1787393192.309670:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+57:11485:x1874217319607040:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 716us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393192.309678:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 170 00010000:00010000:3.0:1787393192.424141:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787393193.146689:0:12387:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787393193.146699:0:12387:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787393193.146789:0:12387:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787393193.146797:0:12387:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787393193.192125:0:11566:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787393193.192136:0:11566:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787393193.192174:0:11566:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787393193.192180:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787393193.192294:0:11566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca22300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11566:1874217338476928:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787393193.192411:0:11566:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787393193.219334:0:11566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca22300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11566:1874217338476928:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787393193.219551:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393193.219586:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319607168 00000100:00100000:3.0:1787393193.219592:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319607168 00000100:00080000:2.0:1787393193.221125:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393193.223864:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 171 00000100:00100000:3.0:1787393193.223883:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+57:11498:x1874217319607168:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787393193.223926:0:5820:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787393193.224193:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+57:11498:x1874217319607168:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 316us (4641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393193.224215:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 171 00000100:00100000:0.0:1787393193.227011:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393193.227107:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319607296 00000100:00100000:1.0:1787393193.227116:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319607296 00000100:00100000:1.0:1787393193.227171:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 172 00000100:00100000:1.0:1787393193.227181:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+57:11498:x1874217319607296:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787393193.227248:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f35 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227264:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f35 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227287:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f35 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227320:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f3c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227328:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227335:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227357:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1f43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227365:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227371:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393193.227405:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787393193.227409:0:10433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393193.227418:0:10433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227428:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f35 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227434:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f35 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227450:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f35 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227456:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385bc00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393193.227460:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f35 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227467:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f35 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227478:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9de8184fc100) 00010000:00010000:1.0:1787393193.227481:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393193.227485:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f35 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227492:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f35 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227502:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227508:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f3c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227514:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f3c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227519:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385aa00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393193.227522:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f3c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227535:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f3c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227542:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9de80398fb00) 00010000:00010000:1.0:1787393193.227544:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393193.227546:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f3c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227552:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f3c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227564:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227570:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1f43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227575:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1f43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227580:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393193.227583:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1f43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227589:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1f43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227595:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8200) 00010000:00010000:1.0:1787393193.227597:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393193.227599:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1f43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.227612:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a800/0x19a927d9c62f1f43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393193.227690:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+57:11498:x1874217319607296:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 Request processed in 510us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393193.227697:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 172 00000100:00100000:1.0:1787393193.237599:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393193.240587:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319607552 00000100:00100000:3.0:1787393193.240601:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319607552 00000100:00100000:3.0:1787393193.240693:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 173 00000100:00100000:3.0:1787393193.240703:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+57:11498:x1874217319607552:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787393193.240723:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393193.240745:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1f4a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d8e9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.240876:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1f51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.240890:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1f51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.240909:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1f51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393193.240922:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787393193.241014:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1f51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.241022:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1f51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.241041:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1f51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.241047:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393193.241051:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1f51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.241066:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1f51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.241078:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8200) 00010000:00010000:3.0:1787393193.241081:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787393193.241085:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1f51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.241092:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1f51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.241128:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1f4a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8e9 expref: 59 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.241137:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9de8184fc100) 00010000:00010000:3.0:1787393193.241139:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787393193.241144:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1f4a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8e9 expref: 59 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.241152:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531600, rc 0) 00000100:00100000:3.0:1787393193.241210:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+58:11498:x1874217319607552:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 509us (3621us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787393193.241217:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 173 00000100:00100000:1.0:1787393193.247370:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393193.247434:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319607680 00000100:00100000:2.0:1787393193.247443:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319607680 00000100:00100000:2.0:1787393193.247501:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 174 00000100:00100000:2.0:1787393193.247511:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+58:11498:x1874217319607680:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787393193.247546:0:10433:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787393193.247783:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+58:11498:x1874217319607680:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 272us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393193.247791:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 174 00000100:00100000:0.0:1787393193.260050:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393193.260163:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319607936 00000100:00100000:3.0:1787393193.260173:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319607936 00000100:00100000:3.0:1787393193.260228:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 175 00000100:00100000:3.0:1787393193.260238:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+58:11498:x1874217319607936:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787393193.260267:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393193.260270:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787393193.260295:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d600/0x19a927d9c62f1f0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8db expref: 58 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.260318:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:3.0:1787393193.260322:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787393193.260335:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1f5f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d8f0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787393193.260733:0:5821:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787393193.260963:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1f66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.260976:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.260987:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.261033:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1f5f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8f0 expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.261047:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1f66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8f0 expref: 59 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.261055:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9de8063da400) 00010000:00010000:3.0:1787393193.261057:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787393193.261066:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530400, rc 0) 00000100:00100000:3.0:1787393193.261119:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+59:11498:x1874217319607936:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 882us (1077us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787393193.261128:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 175 00000100:00100000:2.0:1787393193.278346:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393193.278412:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319608192 00000100:00100000:1.0:1787393193.278426:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319608192 00000100:00100000:1.0:1787393193.278481:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 176 00000100:00100000:1.0:1787393193.278490:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+59:11498:x1874217319608192:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787393193.278543:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393193.278572:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f1f66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8f0 expref: 59 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.278588:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9de8063da400) 00010000:00010000:1.0:1787393193.278599:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787393193.278620:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f74 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.278632:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.278642:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.278711:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x2634a1e2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.278727:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2634a1e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.278734:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2634a1e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.278817:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.278825:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f74 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.278832:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.278861:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385aa00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393193.278865:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.278873:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f74 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.278882:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:1.0:1787393193.278885:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393193.278889:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.279386:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385aa00/0x19a927d9c62f1f74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.279398:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2634a1e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.279410:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2634a1e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.279416:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2634a1e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.279421:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385bc00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393193.279424:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2634a1e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.279430:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2634a1e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.279438:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x2634a1e2 (ffff9de80398fb00) 00010000:00010000:1.0:1787393193.279441:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393193.279443:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2634a1e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.279449:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2634a1e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393193.279528:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+58:11498:x1874217319608192:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 1038us (1189us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787393193.279536:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 176 00000100:00100000:1.0:1787393193.282490:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393193.282565:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319608320 00000100:00100000:3.0:1787393193.282575:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319608320 00000100:00100000:3.0:1787393193.282633:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 177 00000100:00100000:3.0:1787393193.282642:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+58:11498:x1874217319608320:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787393193.282664:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393193.282695:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1f82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d8f7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.282728:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1f89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.282740:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.282752:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.282865:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1f82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8f7 expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.282881:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1f89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8f7 expref: 59 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.283021:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9de8063da900) 00010000:00010000:3.0:1787393193.283080:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787393193.283091:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530600, rc 0) 00000100:00100000:3.0:1787393193.283154:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+59:11498:x1874217319608320:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 512us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393193.283162:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 177 00000100:00100000:0.0:1787393193.286410:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393193.286874:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319608576 00000100:00100000:3.0:1787393193.286883:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319608576 00000100:00100000:3.0:1787393193.286948:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 178 00000100:00100000:3.0:1787393193.286958:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+59:11498:x1874217319608576:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787393193.287043:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1f90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.287059:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1f90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.287071:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1f90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787393193.287350:0:10433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1787393193.287361:0:10433:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 342462520923ns, next at 343462518478ns, rc = 0 00000004:00010000:3.0:1787393193.287452:0:10433:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d3b8c596 reply state 00000000a4716a68 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1f90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393193.287461:0:10433:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787393193.287551:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+61:11498:x1874217319608576:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 593us (1148us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1787393193.287558:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 178 00000100:00100000:1.0:1787393193.310330:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00010000:00010000:1.0:1787393193.310366:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1f90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.310378:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1f90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.310391:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1f90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.310397:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393193.310402:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1f90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.310410:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1f90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.310427:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9de8063da900) 00010000:00010000:1.0:1787393193.310430:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787393193.310434:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1f90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.310441:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f1f90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393193.310470:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319608704 00000100:00100000:1.0:1787393193.310479:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319608704 00000100:00100000:1.0:1787393193.310525:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 179 00000100:00100000:1.0:1787393193.310533:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:11498:x1874217319608704:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787393193.310555:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393193.310571:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d8fe expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.310630:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8fe expref: 61 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.310657:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8fe expref: 61 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.311098:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9de8063da900) 00010000:00010000:1.0:1787393193.311102:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787393193.311105:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385bc00, rc 0) 00000100:00100000:1.0:1787393193.311195:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+61:11498:x1874217319608704:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 661us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393193.311203:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 179 00000100:00100000:2.0:1787393193.333118:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393193.333167:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319608832 00000100:00100000:2.0:1787393193.333177:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319608832 00000100:00100000:2.0:1787393193.333234:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:2.0:1787393193.333243:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319608832:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787393193.333554:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2355:x1874217319608832:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 311us (1534us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787393193.333562:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00080000:2.0:1787393193.333583:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787393193.346690:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393193.346761:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319609088 00000100:00100000:2.0:1787393193.346783:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319609088 00000100:00100000:2.0:1787393193.346830:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:2.0:1787393193.346877:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+61:11498:x1874217319609088:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787393193.347122:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+62:11498:x1874217319609088:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 283us (439us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1787393193.347130:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:3.0:1787393193.351571:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393193.351603:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319609344 00000100:00100000:3.0:1787393193.351619:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319609344 00000100:00100000:3.0:1787393193.351667:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 180 00000100:00100000:3.0:1787393193.351677:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+62:11498:x1874217319609344:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787393193.351774:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+62:11498:x1874217319609344:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 98us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393193.351781:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 180 00000100:00100000:3.0:1787393193.370178:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393193.370271:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319609472 00000100:00100000:0.0:1787393193.370281:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319609472 00000100:00100000:0.0:1787393193.370340:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 181 00000100:00100000:0.0:1787393193.370350:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+62:11498:x1874217319609472:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787393193.370370:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393193.370390:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1f9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d905 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.370493:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1fa5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.370531:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.370543:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393193.370584:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787393193.370602:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.370629:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1f9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d905 expref: 64 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.370671:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d905 expref: 63 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.370679:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9de8063da900) 00010000:00010000:0.0:1787393193.370682:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787393193.370686:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761d400, rc 0) 00000100:00100000:0.0:1787393193.370745:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+63:11498:x1874217319609472:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 396us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393193.370753:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 181 00000100:00100000:3.0:1787393193.376567:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393193.377011:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319609600 00000100:00100000:0.0:1787393193.377020:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319609600 00000100:00100000:0.0:1787393193.377070:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00100000:0.0:1787393193.377079:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2354:x1874217319609600:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787393193.377097:0:7525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393193.377117:0:7525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003acc3ab7/0x19a927d9c62f1fac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d90c expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787393193.377142:0:7525:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8974a9, blocks: 0x1 00010000:00010000:0.0:1787393193.377161:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=342s v=(0 0) 00010000:00010000:0.0:1787393193.377166:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393193.377175:0:7525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003acc3ab7/0x19a927d9c62f1fac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d90c expref: 8 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.377193:0:7525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003acc3ab7/0x19a927d9c62f1fac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d90c expref: 8 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.377225:0:7525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761da00, rc 0) 00000100:00100000:0.0:1787393193.377316:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2354:x1874217319609600:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 237us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393193.377323:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00100000:3.0:1787393193.386464:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393193.386605:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319609856 00000100:00100000:0.0:1787393193.386618:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319609856 00000100:00100000:0.0:1787393193.386694:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 182 00000100:00100000:0.0:1787393193.386706:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+63:11498:x1874217319609856:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787393193.387016:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+63:11498:x1874217319609856:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 310us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393193.388105:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 182 00000100:00100000:3.0:1787393193.392230:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393193.392340:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319609984 00000100:00100000:2.0:1787393193.392357:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319609984 00000100:00100000:2.0:1787393193.392439:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 53 00000100:00100000:2.0:1787393193.392450:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f68a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:11498:x1874217319609984:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787393193.392469:0:6622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393193.392491:0:6622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f1fb3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d913 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.392527:0:6622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003acc3ab7/0x19a927d9c62f1fac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d90c expref: 9 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.392537:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787393193.392542:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787393193.392547:0:6622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f1fb3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d913 expref: 9 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.392579:0:6622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003acc3ab7/0x19a927d9c62f1fac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d90c expref: 9 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.392592:0:6622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003acc3ab7/0x19a927d9c62f1fac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d90c expref: 9 pid: 7525 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393193.392605:0:6622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6622:1874217338477056:192.168.203.21@tcp:104: 00000100:00100000:2.0:1787393193.392747:0:6622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787393193.405429:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393193.405511:0:6622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6622:1874217338477056:192.168.203.21@tcp:104: 00010000:00010000:2.0:1787393193.405561:0:6622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f1fb3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d913 expref: 9 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.405612:0:6622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5e00, rc 0) 00000100:00100000:1.0:1787393193.405636:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319610112 00000100:00100000:1.0:1787393193.405647:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319610112 00010000:00010000:1.0:1787393193.406487:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003acc3ab7/0x19a927d9c62f1fac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d90c expref: 10 pid: 7525 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393193.406526:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:1.0:1787393193.406536:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f688000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:2355:x1874217319610112:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393193.406552:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393193.407209:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003acc3ab7/0x19a927d9c62f1fac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d90c expref: 10 pid: 7525 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.407228:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003acc3ab7/0x19a927d9c62f1fac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d90c expref: 10 pid: 7525 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.407253:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003acc3ab7/0x19a927d9c62f1fac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d90c expref: 10 pid: 7525 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.407290:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393193.407295:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393193.407304:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f1fb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d913 expref: 9 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.407315:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f1fb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d913 expref: 9 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393193.407374:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f68a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:11498:x1874217319609984:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 14917us (15147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393193.407387:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 53 00010000:00010000:0.0:1787393193.408224:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f1fb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d913 expref: 8 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393193.408245:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83caa7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5806:1874217338477184:192.168.203.21@tcp:105: 00000100:00100000:0.0:1787393193.408322:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351c2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787393193.415467:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393193.415473:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83caa7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5806:1874217338477184:192.168.203.21@tcp:105: 00010000:00010000:0.0:1787393193.415514:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393193.415597:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f688000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2355:x1874217319610112:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 9061us (10178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393193.415607:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:2.0:1787393193.416243:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319610240 00000100:00100000:2.0:1787393193.416255:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319610240 00002000:00100000:2.0:1787393193.416321:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9de83f68bb80 x1874217319610240/t0(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:164/0 lens 504/0 e 0 to 0 dl 1787393204 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787393193.416334:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de83f68bb80 with x1874217319610240 ext(0->8) 00002000:00010000:2.0:1787393193.416341:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de83f68bb80 00000100:00100000:2.0:1787393193.416376:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:2.0:1787393193.416387:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2355:x1874217319610240:12345-192.168.203.21@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787393193.424446:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:2355:x1874217319610240:12345-192.168.203.21@tcp:4:lhsmtool_posix.0 Request processed in 8048us (8985us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787393193.425565:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00002000:00100000:2.0:1787393193.425580:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9de83f68bb80 x1874217319610240/t4294967315(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:164/0 lens 504/448 e 0 to 0 dl 1787393204 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787393193.425591:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de83f68bb80 with x1874217319610240 ext(0->8) 00002000:00010000:2.0:1787393193.425597:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de83f68bb80 00000100:00100000:3.0:1787393193.430214:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393193.430379:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319610368 00000100:00100000:0.0:1787393193.430393:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319610368 00000100:00100000:0.0:1787393193.430546:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 183 00000100:00100000:0.0:1787393193.430560:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+63:11498:x1874217319610368:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1787393193.448218:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787393193.464459:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000004:00080000:3.0:1787393193.464480:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:1.0:1787393193.464666:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338477312:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787393193.464741:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1787393193.465384:0:12402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000001:00080000:2.0:1787393193.465431:0:12402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1787393193.465445:0:12402:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:1.0:1787393193.465594:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787393193.465605:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338477440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787393193.465641:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393193.465785:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338477312 00000100:00100000:2.0:1787393193.465798:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338477312 00000100:00100000:2.0:1787393193.465875:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338477440 00000100:00100000:2.0:1787393193.465879:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338477440 00000100:00100000:2.0:1787393193.465913:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787393193.465921:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3326:x1874217338477312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787393193.465946:0:6624:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1787393193.465978:0:6624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8974a6, atime: 0x6a8974a6, ctime: 0x6a8974a6, blocks: 0x1 00010000:00010000:2.0:1787393193.465986:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1fba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.466003:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1787393193.466007:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787393193.466013:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1fba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.466036:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1fba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.466046:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1fba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.466054:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1fba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.466071:0:6624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1787393193.466484:0:5842:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9de8351c2900 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787393193.466489:0:5842:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9de8085fb800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9de8351c2a80 00000020:00080000:3.0:1787393193.466492:0:5842:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9de8085fb400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9de82d27c000 00000100:00100000:2.0:1787393193.466552:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787393193.466560:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338477440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787393193.466671:0:6625:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00000100:00100000:0.0:1787393193.466748:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+18:11498:x1874217319610368:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 Request processed in 36189us (36546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393193.466757:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 183 00000100:00080000:1.0:1787393193.466822:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787393193.466826:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1787393193.466903:0:6625:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787393193 00002000:00010000:2.0:1787393193.466906:0:6625:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787393193.466908:0:6625:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787393193 -> 1787393193 00002000:00010000:2.0:1787393193.466910:0:6625:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787393193.467004:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3326:x1874217338477440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 445us (1361us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787393193.467011:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787393193.467011:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3326:x1874217338477312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1091us (2271us total) trans 4294967307 rc 0/0 00010000:00010000:2.0:1787393193.467036:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787393193.467044:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1fba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.467052:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4000 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393193.467057:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1fba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.467067:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1fba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.467084:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1fba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.467091:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070deb482/0x19a927d9c62f1fba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.467108:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393193.467110:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393193.467117:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787393193.467125:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1787393193.467226:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000020:00080000:2.0:1787393193.467242:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000004:00080000:1.0:1787393193.467331:0:3326:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9de83c5a7100/2, rc 0, transno 4294967316 00000100:00100000:1.0:1787393193.467338:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338477440:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1787393193.467350:0:3326:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9de83ca8d180/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787393193.467354:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338477312:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787393193.471396:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393193.471463:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319610496 00000100:00100000:0.0:1787393193.471473:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319610496 00000100:00100000:0.0:1787393193.471525:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 56 00000100:00100000:0.0:1787393193.471536:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f68a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:2355:x1874217319610496:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787393193.516465:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f68a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:2355:x1874217319610496:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 Request processed in 44920us (45066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393193.516478:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 56 00000001:00080000:2.0:1787393193.517662:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:2.0:1787393193.517676:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1787393193.522118:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393193.522246:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319610752 00000100:00100000:3.0:1787393193.522255:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319610752 00000100:00100000:3.0:1787393193.522360:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 184 00000100:00100000:3.0:1787393193.522370:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+18:11498:x1874217319610752:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787393193.522422:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393193.522448:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d400/0x19a927d9c62f1fa5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d905 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.522487:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9de8063da900) 00010000:00010000:3.0:1787393193.522492:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787393193.522521:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1fc1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.522533:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.522543:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787393193.523062:0:5822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b663e541 reply state 00000000f3bac744 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393193.523072:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787393193.523170:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:11498:x1874217319610752:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 800us (1060us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787393193.523179:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 184 00000100:00100000:1.0:1787393193.527406:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00010000:00010000:2.0:1787393193.530085:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.530102:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1fc1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.530233:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1fc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.530240:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393193.530246:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1fc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.530253:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1fc1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.530271:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9de8063da900) 00010000:00010000:2.0:1787393193.530274:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393193.530278:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1fc1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.530284:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f1fc1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393193.530538:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319610880 00000100:00100000:3.0:1787393193.530548:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319610880 00000100:00100000:3.0:1787393193.530646:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:3.0:1787393193.530658:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2356:x1874217319610880:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787393193.531254:0:6625:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787393193.531259:0:6625:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787393193 -> 1787393192 00002000:00010000:3.0:1787393193.531262:0:6625:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787393190 00002000:00010000:3.0:1787393193.531264:0:6625:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787393193 -> 1787393192 00002000:00010000:3.0:1787393193.531267:0:6625:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787393193.531346:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2356:x1874217319610880:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 689us (3947us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787393193.531356:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:2.0:1787393193.535386:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393193.535480:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319611136 00000100:00100000:1.0:1787393193.535503:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319611136 00000100:00100000:1.0:1787393193.535597:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 185 00000100:00100000:1.0:1787393193.535608:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8186b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+18:11498:x1874217319611136:12345-192.168.203.21@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787393193.535676:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fc8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.535693:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1f89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8f7 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.535703:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fc8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.535736:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1f89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8f7 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.535749:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1f89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8f7 expref: 18 pid: 5821 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393193.535764:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1874217338477568:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393193.535887:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83f6bcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787393193.539740:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393193.539828:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319611264 00000100:00100000:3.0:1787393193.539868:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319611264 00010000:00010000:3.0:1787393193.539920:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1f89 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8f7 expref: 19 pid: 5821 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393193.539949:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 70 00000100:00100000:3.0:1787393193.539958:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:2356:x1874217319611264:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787393193.539972:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393193.539979:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1f89 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8f7 expref: 19 pid: 5821 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.539992:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1f89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8f7 expref: 19 pid: 5821 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.540014:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9de8063da900) 00010000:00010000:3.0:1787393193.540019:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fc8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.540038:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.540047:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fc8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.540065:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393193.540128:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:2356:x1874217319611264:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 170us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393193.540145:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 70 00010000:00010000:1.0:1787393193.540520:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1f89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8f7 expref: 18 pid: 5821 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393193.540539:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1874217338477568:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393193.540560:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.540569:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.540582:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.540612:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.540620:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fc8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.540627:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.540633:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385b400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393193.540638:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.540645:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fc8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.540655:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9de8063da900) 00010000:00010000:1.0:1787393193.540658:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787393193.540663:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fc8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.540670:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fc8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393193.540712:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8186b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+17:11498:x1874217319611136:12345-192.168.203.21@tcp:55:lhsmtool_posix.0 Request processed in 5107us (5335us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787393193.540721:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 185 00000100:00100000:3.0:1787393193.560324:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393193.560482:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319611392 00000100:00100000:2.0:1787393193.560507:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319611392 00000100:00100000:2.0:1787393193.560567:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00100000:2.0:1787393193.560579:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2353:x1874217319611392:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787393193.560624:0:6622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a152db35/0x19a927d9c62f1fcf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.560645:0:6622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f1fb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d913 expref: 8 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.560774:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787393193.560778:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787393193.560783:0:6622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a152db35/0x19a927d9c62f1fcf lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.560820:0:6622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f1fb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d913 expref: 8 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.560835:0:6622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f1fb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d913 expref: 8 pid: 6622 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393193.561189:0:6622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8012af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6622:1874217338477696:192.168.203.21@tcp:104: 00000100:00100000:2.0:1787393193.561273:0:6622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787393193.569928:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393193.570330:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319611520 00000100:00100000:1.0:1787393193.570341:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319611520 00010000:00010000:1.0:1787393193.570395:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f1fb3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d913 expref: 9 pid: 6622 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393193.570441:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 71 00000100:00100000:1.0:1787393193.570451:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f689500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:2356:x1874217319611520:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393193.570467:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393193.570488:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f1fb3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d913 expref: 9 pid: 6622 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.570502:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f1fb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d913 expref: 9 pid: 6622 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.570527:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787393193.570532:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787393193.570537:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a152db35/0x19a927d9c62f1fcf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.570547:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a152db35/0x19a927d9c62f1fcf lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.570567:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393193.570625:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f689500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:2356:x1874217319611520:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 176us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393193.570632:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 71 00010000:00010000:0.0:1787393193.572630:0:6622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f1fb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d913 expref: 8 pid: 6622 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393193.572700:0:6622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8012af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6622:1874217338477696:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787393193.572723:0:6622:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a152db35/0x19a927d9c62f1fcf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.572735:0:6622:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a152db35/0x19a927d9c62f1fcf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.572743:0:6622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a152db35/0x19a927d9c62f1fcf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.574063:0:6622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a152db35/0x19a927d9c62f1fcf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.574083:0:6622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a152db35/0x19a927d9c62f1fcf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.574092:0:6622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a152db35/0x19a927d9c62f1fcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.574100:0:6622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4400 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393193.574105:0:6622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a152db35/0x19a927d9c62f1fcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.574114:0:6622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a152db35/0x19a927d9c62f1fcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.574135:0:6622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a152db35/0x19a927d9c62f1fcf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.574144:0:6622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a152db35/0x19a927d9c62f1fcf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393193.574250:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2353:x1874217319611392:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 Request processed in 13670us (13931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393193.574260:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00100000:3.0:1787393193.578686:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393193.578757:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319611776 00000100:00100000:1.0:1787393193.578781:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319611776 00000100:00100000:1.0:1787393193.578872:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 186 00000100:00100000:1.0:1787393193.579050:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f68b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+17:11498:x1874217319611776:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787393193.579134:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.579152:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.579163:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.580038:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1fdd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.580054:0:10433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8fe expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.580062:0:10433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1fdd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.580096:0:10433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8fe expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.580112:0:10433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8fe expref: 18 pid: 5821 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393193.580127:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338477824:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393193.580691:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83f6bcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787393193.596927:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338477824:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393193.596957:0:10433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1fdd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393193.606118:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393193.606597:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319611904 00000100:00100000:2.0:1787393193.606607:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319611904 00010000:00010000:2.0:1787393193.606644:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8fe expref: 19 pid: 5821 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393193.606752:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 72 00000100:00100000:2.0:1787393193.606762:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f688e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:2356:x1874217319611904:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393193.606776:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393193.606783:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8fe expref: 19 pid: 5821 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.606795:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8fe expref: 19 pid: 5821 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.606816:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f1f97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8fe expref: 19 pid: 5821 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.606831:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9de8063da900) 00010000:00010000:2.0:1787393193.606885:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1fdd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.606905:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1fdd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.606913:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1fdd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.606947:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787393193.606991:0:10433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1fdd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.607003:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1fdd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393193.607004:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f688e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+18:2356:x1874217319611904:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 242us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393193.607020:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 72 00000001:00080000:3.0:1787393193.607215:0:10433:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787393193.607355:0:10433:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787393193.607402:0:10433:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787393193.607479:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f689880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10433:1874217338477952:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787393193.607530:0:10433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393193.607557:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787393193.607577:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338477952 00000100:00100000:3.0:1787393193.607581:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338477952 00000100:00100000:3.0:1787393193.607631:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787393193.607639:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f68aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10433:x1874217338477952:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787393193.607709:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f68aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10433:x1874217338477952:12345-0@lo:1000:mdt00_003.0 Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393193.607716:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787393193.607761:0:10433:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1787393193.607766:0:10433:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9de83c5a7100, transno 4294967316 00000100:00100000:3.0:1787393193.607778:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f689880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10433:1874217338477952:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787393193.609450:0:10433:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787393193.609522:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f689880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10433:1874217338478080:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787393193.609573:0:10433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393193.609617:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787393193.609690:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338478080 00000100:00100000:0.0:1787393193.609697:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338478080 00000100:00100000:0.0:1787393193.609744:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787393193.609752:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10433:x1874217338478080:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787393193.609970:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10433:x1874217338478080:12345-0@lo:1000:mdt00_003.0 Request processed in 218us (396us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787393193.609977:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787393193.610184:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f689880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10433:1874217338478080:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787393193.610216:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1fdd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610227:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1fdd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610234:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1fdd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610241:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385b000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393193.610246:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1fdd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610254:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1fdd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610270:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9de8063da900) 00010000:00010000:3.0:1787393193.610273:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787393193.610277:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1fdd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610283:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f1fdd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610319:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1f12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610326:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1f12 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610332:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1f12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610338:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393193.610341:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1f12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610347:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1f12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610356:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8200) 00010000:00010000:3.0:1787393193.610359:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787393193.610362:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1f12 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610368:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f1f12 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610387:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1fe4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610401:0:10433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1f2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8e2 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610410:0:10433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1fe4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610441:0:10433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1f2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8e2 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393193.610455:0:10433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1f2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8e2 expref: 21 pid: 5822 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393193.610467:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f688380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338478208:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393193.610533:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787393193.614761:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f688380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338478208:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393193.614790:0:10433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1fe4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393193.621676:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393193.621803:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319612032 00000100:00100000:1.0:1787393193.621819:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319612032 00010000:00010000:1.0:1787393193.622123:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1f2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8e2 expref: 22 pid: 5822 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393193.622162:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:1.0:1787393193.622173:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+22:2355:x1874217319612032:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393193.622187:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393193.622194:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1f2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8e2 expref: 22 pid: 5822 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.622207:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1f2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8e2 expref: 22 pid: 5822 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.622229:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a400/0x19a927d9c62f1f2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d8e2 expref: 22 pid: 5822 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.622245:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8200) 00010000:00010000:1.0:1787393193.622250:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1fe4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.622258:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1fe4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.622266:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1fe4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.622300:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787393193.622810:0:10433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1fe4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.622821:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1fe4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.622834:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1fe4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.622858:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1fe4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.622865:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1fe4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.622871:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393193.622985:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1fe4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.622995:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1fe4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.623007:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8200) 00010000:00010000:2.0:1787393193.623010:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393193.623013:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1fe4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.623019:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1fe4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.623095:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.623115:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.623121:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.623126:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385b400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393193.623129:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.623134:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fd6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.623142:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8200) 00010000:00010000:2.0:1787393193.623145:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787393193.623147:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fd6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393193.623152:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b400/0x19a927d9c62f1fd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393193.623465:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:2355:x1874217319612032:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 1290us (1794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393193.623485:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:2.0:1787393193.623641:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f68b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:11498:x1874217319611776:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 44594us (44964us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1787393193.623649:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 186 00000020:00080000:2.0:1787393193.623652:0:10433:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787393193.625780:0:11566:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787393193.625788:0:11566:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787393193.627771:0:11566:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787393193.627786:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787393193.634228:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393193.634519:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319612288 00000100:00100000:0.0:1787393193.634530:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319612288 00000100:00100000:0.0:1787393193.634776:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:0.0:1787393193.634787:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818e27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:11498:x1874217319612288:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787393193.636441:0:5823:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787393193.636551:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1787393193.636677:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1feb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.636692:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1feb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.636910:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1feb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.636922:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1feb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.636928:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1feb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.636935:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1feb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393193.637022:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787393193.637132:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818e27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+22:11498:x1874217319612288:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 2343us (2910us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787393193.637142:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 50 00000020:00080000:0.0:1787393193.637147:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787393193.638663:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787393193.638673:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1feb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.638683:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761c200 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:1.0:1787393193.638687:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1feb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.638695:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1feb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.638717:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9de803da2200) 00010000:00010000:1.0:1787393193.638721:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787393193.638725:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1feb lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.638731:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c200/0x19a927d9c62f1feb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393193.638990:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393193.638993:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393193.638994:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393193.816390:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393193.816432:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393193.816470:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393193.816880:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319612544 00000100:00100000:3.0:1787393193.816889:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319612544 00000100:00100000:3.0:1787393193.816963:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 70 00000100:00100000:3.0:1787393193.816973:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2354:x1874217319612544:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393193.817104:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2354:x1874217319612544:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 131us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393193.817112:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 70 00000100:00080000:2.0:1787393193.817180:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787393193.817681:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319612416 00000100:00100000:0.0:1787393193.817686:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319612416 00000100:00100000:0.0:1787393193.817719:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 291 00000100:00100000:0.0:1787393193.817726:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:2354:x1874217319612416:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393193.817775:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:2354:x1874217319612416:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 48us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393193.817783:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 291 00000100:00100000:1.0:1787393193.817790:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319612672 00000100:00100000:1.0:1787393193.817796:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319612672 00000100:00080000:0.0:1787393193.817829:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393193.817875:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 145 00000100:00100000:1.0:1787393193.817885:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2354:x1874217319612672:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393193.817936:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2354:x1874217319612672:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 54us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393193.817945:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 145 00000001:00080000:2.0:1787393193.892235:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1787393193.892250:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1787393194.345298:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787393194.345320:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338478336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787393194.345387:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393194.345569:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338478336 00000100:00100000:3.0:1787393194.345577:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338478336 00000100:00100000:3.0:1787393194.345626:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787393194.345636:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3325:x1874217338478336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787393194.345668:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787393194.345713:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3325:x1874217338478336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393194.345727:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787393194.348801:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338478336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787393194.472759:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393194.858130:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338478720:0@lo:400:kworker.0 00000100:00100000:0.0:1787393194.858198:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393194.858257:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787393194.858263:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83caa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338478592:0@lo:400:kworker.0 00000100:00100000:0.0:1787393194.858306:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393194.858333:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338479104:0@lo:400:kworker.0 00000100:00100000:0.0:1787393194.858443:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393194.858474:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338478720 00000100:00100000:0.0:1787393194.858481:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338478720 00000100:00100000:0.0:1787393194.858535:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338478592 00000100:00100000:0.0:1787393194.858539:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338478592 00000100:00100000:0.0:1787393194.858561:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787393194.858568:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338478720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393194.858621:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338478720:12345-0@lo:400:kworker.0 Request processed in 52us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393194.858627:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787393194.858643:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787393194.858649:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338478592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393194.858675:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338478592:12345-0@lo:400:kworker.0 Request processed in 26us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393194.858680:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1787393194.858695:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393194.858727:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83caa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338478592:0@lo:400:kworker.0 00000100:00100000:0.0:1787393194.858737:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338478720:0@lo:400:kworker.0 00000100:00100000:2.0:1787393194.859727:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338478848:0@lo:400:kworker.0 00000100:00100000:2.0:1787393194.859776:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393194.859820:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787393194.859827:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83caa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338478464:0@lo:400:kworker.0 00000100:00100000:2.0:1787393194.859875:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393194.859910:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338478976:0@lo:400:kworker.0 00000100:00100000:2.0:1787393194.859934:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393194.859962:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338478976 00000100:00100000:2.0:1787393194.859967:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338478976 00000100:00100000:2.0:1787393194.860008:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787393194.860014:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338478976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393194.860036:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338479104 00000100:00100000:0.0:1787393194.860040:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338479104 00000100:00100000:2.0:1787393194.860054:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338478976:12345-0@lo:400:kworker.0 Request processed in 40us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393194.860060:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787393194.860077:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338478464 00000100:00100000:2.0:1787393194.860086:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338478464 00000100:00100000:2.0:1787393194.860106:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787393194.860111:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338478464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393194.860138:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338478464:12345-0@lo:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393194.860144:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:2.0:1787393194.860172:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787393194.860193:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83caa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338478464:0@lo:400:kworker.0 00000100:00100000:2.0:1787393194.860205:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338478976:0@lo:400:kworker.0 00000100:00100000:0.0:1787393194.860391:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338478848 00000100:00100000:0.0:1787393194.860394:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338478848 00000100:00100000:0.0:1787393194.860418:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787393194.860424:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338479104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393194.860459:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338479104:12345-0@lo:400:kworker.0 Request processed in 36us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393194.860476:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787393194.860486:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787393194.860491:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3324:x1874217338478848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393194.860702:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3324:x1874217338478848:12345-0@lo:400:kworker.0 Request processed in 210us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393194.860709:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787393194.860741:0:3327:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1787393194.860746:0:3327:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1787393194.860760:0:3327:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9de83ca8d180, transno 4294967307 00000100:00100000:0.0:1787393194.860770:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338479104:0@lo:400:kworker.0 00000100:00100000:2.0:1787393194.860820:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338478848:0@lo:400:kworker.0 00000040:00080000:3.0:1787393194.933122:0:12442:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787393194.933134:0:12442:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787393194.933171:0:12442:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787393194.933178:0:12442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787393195.073200:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393195.073285:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319612928 00000100:00100000:3.0:1787393195.073296:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319612928 00000100:00100000:3.0:1787393195.073365:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 187 00000100:00100000:3.0:1787393195.073376:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+22:11515:x1874217319612928:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1787393195.073400:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393195.073421:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1ff2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d91a expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787393195.073915:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787393195.074189:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1ff9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.074205:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1ff9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.074228:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1ff9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393195.074240:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787393195.074636:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f1ff2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d91a expref: 25 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.074654:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1ff9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d91a expref: 24 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.074675:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:3.0:1787393195.074678:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787393195.074681:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530600, rc 0) 00000100:00100000:3.0:1787393195.075051:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+24:11515:x1874217319612928:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1675us (1858us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787393195.075063:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 187 00000100:00100000:2.0:1787393195.089202:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393195.089279:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319613056 00000100:00100000:3.0:1787393195.089289:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319613056 00000100:00100000:3.0:1787393195.089348:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 188 00000100:00100000:3.0:1787393195.089362:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+24:11515:x1874217319613056:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:3.0:1787393195.089438:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2007 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.089455:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2007 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.089466:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2007 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.089479:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f200e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.089486:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f200e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.089493:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f200e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.089795:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f2015 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.089804:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f2015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.089810:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f2015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787393195.089878:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f2015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.089971:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2007 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.089978:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2007 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.089985:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2007 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.089991:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393195.089995:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2007 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.090003:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2007 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.090014:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:3.0:1787393195.090017:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393195.090021:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2007 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.090033:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2007 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.090045:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f200e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.090051:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f200e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.090057:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f200e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.090062:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393195.090065:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f200e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.090072:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f200e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.090080:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de8063da400) 00010000:00010000:3.0:1787393195.090083:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393195.090085:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f200e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.090091:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f200e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.090105:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f2015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.090111:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f2015 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.090122:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f2015 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.090127:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393195.090130:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f2015 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.090137:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f2015 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.090145:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de8063da900) 00010000:00010000:3.0:1787393195.090148:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393195.090151:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f2015 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.090157:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f2015 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393195.090230:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+24:11515:x1874217319613056:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 873us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393195.090240:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 188 00000100:00100000:0.0:1787393195.180814:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393195.180935:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319613312 00000100:00100000:2.0:1787393195.180945:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319613312 00000100:00100000:2.0:1787393195.180993:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 189 00000100:00100000:2.0:1787393195.181001:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+24:11518:x1874217319613312:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1787393195.181021:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393195.181039:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f201c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d921 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181107:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2023 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181120:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2023 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181131:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2023 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181144:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f202a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181150:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f202a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181156:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f202a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181470:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f2031 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181479:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f2031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181496:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f2031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393195.181506:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787393195.181586:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2023 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181593:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2023 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181599:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2023 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181605:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393195.181609:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2023 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181616:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2023 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181637:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:2.0:1787393195.181640:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393195.181644:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2023 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181659:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2023 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181670:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f202a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181676:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f202a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181682:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f202a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181687:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393195.181690:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f202a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181696:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f202a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181702:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de818bd8200) 00010000:00010000:2.0:1787393195.181705:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393195.181707:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f202a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181712:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f202a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181744:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f201c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d921 expref: 27 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181757:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f2031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d921 expref: 26 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.181767:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:2.0:1787393195.181770:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787393195.181772:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4400, rc 0) 00000100:00100000:2.0:1787393195.181836:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+26:11518:x1874217319613312:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 835us (1033us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787393195.181869:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 189 00000100:00100000:2.0:1787393195.185279:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393195.185350:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319613440 00000100:00100000:3.0:1787393195.185360:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319613440 00000100:00100000:3.0:1787393195.185422:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 190 00000100:00100000:3.0:1787393195.185433:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+26:11518:x1874217319613440:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:3.0:1787393195.185502:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f203f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.185518:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f203f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.185545:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f203f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.185572:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f203f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.185579:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f203f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.185586:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f203f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.185592:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393195.185596:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f203f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.185604:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f203f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.185615:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:3.0:1787393195.185618:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787393195.185622:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f203f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.185628:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f203f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393195.185702:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+26:11518:x1874217319613440:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 271us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393195.185710:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 190 00000100:00100000:0.0:1787393195.191608:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393195.191726:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319613696 00000100:00100000:1.0:1787393195.191737:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319613696 00000100:00100000:1.0:1787393195.191793:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:1.0:1787393195.191803:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+26:11518:x1874217319613696:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1787393195.192203:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+27:11518:x1874217319613696:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 400us (603us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1787393195.192211:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:0.0:1787393195.234114:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393195.234927:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319613952 00000100:00100000:2.0:1787393195.234938:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319613952 00000100:00100000:2.0:1787393195.235003:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 191 00000100:00100000:2.0:1787393195.235014:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+27:11042:x1874217319613952:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1787393195.235036:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393195.235056:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f2046 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d928 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.235159:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f204d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.235174:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f2031 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d921 expref: 28 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.235182:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f204d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.235227:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f2031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d921 expref: 28 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.235259:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f2031 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d921 expref: 28 pid: 5821 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393195.235274:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8012ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1874217338479232:192.168.203.21@tcp:104: 00000100:00100000:2.0:1787393195.235576:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787393195.250633:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393195.250713:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319614080 00000100:00100000:3.0:1787393195.250735:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319614080 00010000:00010000:3.0:1787393195.250785:0:11945:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f2031 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d921 expref: 29 pid: 5821 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393195.250823:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 74 00000100:00100000:3.0:1787393195.250833:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+29:2355:x1874217319614080:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787393195.250879:0:11945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393195.250898:0:11945:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f2031 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d921 expref: 29 pid: 5821 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.250912:0:11945:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f2031 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d921 expref: 29 pid: 5821 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.250933:0:11945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:3.0:1787393195.250938:0:11945:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f204d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.250947:0:11945:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f204d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.250955:0:11945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f204d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.250973:0:11945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393195.251079:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+29:2355:x1874217319614080:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 246us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393195.251086:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 74 00010000:00010000:0.0:1787393195.251450:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f2031 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d921 expref: 28 pid: 5821 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393195.251468:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8012ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1874217338479232:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787393195.251487:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f204d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.251497:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f204d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.251503:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f204d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393195.251522:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787393195.251675:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f2046 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d928 expref: 29 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.251690:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f204d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d928 expref: 28 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.251706:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:0.0:1787393195.251710:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787393195.251713:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5600, rc 0) 00000100:00100000:0.0:1787393195.254029:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+28:11042:x1874217319613952:12345-192.168.203.21@tcp:101:bash.0 Request processed in 16742us (17649us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787393195.254044:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 191 00000100:00100000:2.0:1787393195.257533:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393195.257591:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319614336 00000100:00100000:1.0:1787393195.257600:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319614336 00000100:00100000:1.0:1787393195.257690:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 192 00000100:00100000:1.0:1787393195.257701:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+28:11042:x1874217319614336:12345-192.168.203.21@tcp:36:bash.0 00010000:00010000:1.0:1787393195.258138:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f205b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393195.258328:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f205b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393195.258342:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f205b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787393195.258400:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1787393195.258427:0:5820:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d709c874 reply state 0000000026024534 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f205b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393195.258525:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787393195.258573:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1787393195.258678:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+32:11042:x1874217319614336:12345-192.168.203.21@tcp:36:bash.0 Request processed in 979us (1153us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1787393195.258686:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 192 00000020:00080000:1.0:1787393195.258691:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787393195.263683:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393195.264508:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319614464 00000100:00100000:3.0:1787393195.264521:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319614464 00000100:00100000:3.0:1787393195.264596:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 193 00000100:00100000:3.0:1787393195.264607:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+32:11042:x1874217319614464:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1787393195.264630:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393195.264651:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f2062 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d92f expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.264710:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f2062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d92f expref: 33 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.264725:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f2062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d92f expref: 33 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.264745:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:3.0:1787393195.264748:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787393195.264752:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530200, rc 0) 00000100:00100000:3.0:1787393195.267094:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+33:11042:x1874217319614464:12345-192.168.203.21@tcp:101:bash.0 Request processed in 2482us (3413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393195.267105:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 193 00010000:00010000:0.0:1787393195.270261:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f205b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.270277:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f205b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.270284:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f205b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.270290:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385be00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393195.270295:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f205b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.270301:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f205b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.270318:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:0.0:1787393195.270321:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393195.270325:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f205b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.270330:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f205b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393195.273983:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393195.274118:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319614592 00000100:00100000:2.0:1787393195.274128:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319614592 00000100:00080000:0.0:1787393195.274196:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787393195.274211:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 59 00000100:00100000:2.0:1787393195.274231:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:11042:x1874217319614592:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1787393195.274250:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393195.274269:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f2069 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d936 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787393195.274297:0:6624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8974a8, atime: 0x6a8974a6, ctime: 0x6a8974a8, blocks: 0xb 00010000:00010000:2.0:1787393195.274317:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1787393195.274321:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787393195.274330:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f2069 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d936 expref: 8 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.274349:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f2069 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d936 expref: 8 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.274381:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5e00, rc 0) 00000100:00100000:2.0:1787393195.274439:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:11042:x1874217319614592:12345-192.168.203.21@tcp:101:bash.0 Request processed in 219us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393195.274447:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 59 00000100:00100000:1.0:1787393195.285916:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393195.285972:0:6628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319614720 00000100:00100000:0.0:1787393195.285983:0:6628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319614720 00002000:00010000:0.0:1787393195.286022:0:6628:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1787393195.286028:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de83ca8e680 with x1874217319614720 ext(0->18446744073709551615) 00002000:00010000:0.0:1787393195.286040:0:6628:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de83ca8e680. 00000100:00100000:0.0:1787393195.286079:0:6628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:0.0:1787393195.286089:0:6628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2356:x1874217319614720:12345-192.168.203.21@tcp:10:bash.0 00002000:00010000:0.0:1787393195.286392:0:6628:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787393195.286396:0:6628:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787393192 -> 1787393195 00002000:00010000:0.0:1787393195.286399:0:6628:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787393190 -> 1787393190 00002000:00010000:0.0:1787393195.286401:0:6628:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787393192 -> 1787393195 00002000:00010000:0.0:1787393195.286403:0:6628:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787393195.286470:0:6628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:2356:x1874217319614720:12345-192.168.203.21@tcp:10:bash.0 Request processed in 381us (560us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787393195.286479:0:6628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00002000:00010000:0.0:1787393195.286483:0:6628:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1787393195.286486:0:6628:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de83ca8e680 with x1874217319614720 ext(0->18446744073709551615) 00002000:00010000:0.0:1787393195.286491:0:6628:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de83ca8e680. 00000100:00100000:0.0:1787393195.347327:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393195.347470:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319614848 00000100:00100000:3.0:1787393195.347479:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319614848 00000100:00100000:3.0:1787393195.347542:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 194 00000100:00100000:3.0:1787393195.347552:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+32:11532:x1874217319614848:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:3.0:1787393195.347621:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f2070 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.347639:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f2070 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.347669:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f2070 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.347687:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2077 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.347694:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.347701:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348078:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f207e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348088:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f207e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348095:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f207e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787393195.348129:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f207e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348140:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f2070 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348147:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f2070 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348154:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f2070 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348173:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393195.348177:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f2070 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348185:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f2070 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348199:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:3.0:1787393195.348202:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393195.348206:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f2070 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348213:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f2070 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348226:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348233:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2077 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348239:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2077 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348245:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393195.348248:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2077 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348254:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2077 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348273:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de8063da900) 00010000:00010000:3.0:1787393195.348275:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393195.348278:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2077 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348284:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f2077 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348298:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f207e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348304:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f207e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348310:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f207e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348329:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393195.348332:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f207e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348338:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f207e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348346:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:3.0:1787393195.348348:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393195.348351:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f207e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.348357:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f207e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393195.348436:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+32:11532:x1874217319614848:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 885us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393195.348444:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 194 00000100:00100000:0.0:1787393195.369611:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338479360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787393195.369704:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393195.369925:0:6627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338479360 00000100:00100000:3.0:1787393195.369934:0:6627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338479360 00000100:00100000:3.0:1787393195.370005:0:6627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787393195.370026:0:6627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338479360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787393195.370060:0:6627:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787393195.370103:0:6627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338479360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393195.370110:0:6627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787393195.370200:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338479360:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787393195.370236:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787393195.381491:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393195.381650:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319615104 00000100:00100000:2.0:1787393195.381659:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319615104 00000100:00100000:2.0:1787393195.381752:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 195 00000100:00100000:2.0:1787393195.381771:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+32:11535:x1874217319615104:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1787393195.381791:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393195.381813:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f2085 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d93d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.381921:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f208c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.381937:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f208c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.381948:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f208c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.381963:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f2093 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.381969:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f2093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.381994:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f2093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.382671:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f209a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.382681:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f209a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.382689:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f209a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393195.382699:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787393195.382867:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f208c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.382876:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f208c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.382892:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f208c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.382898:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393195.382902:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f208c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.382908:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f208c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.382920:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:2.0:1787393195.382923:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393195.382934:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f208c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.382941:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f208c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.382954:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f2093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.382960:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f2093 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.382966:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f2093 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.382971:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393195.382974:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f2093 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.382979:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f2093 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.382987:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de818bd8d00) 00010000:00010000:2.0:1787393195.382989:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393195.382992:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f2093 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.382998:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f2093 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.383110:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f2085 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d93d expref: 35 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.383136:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f209a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d93d expref: 34 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.383144:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:2.0:1787393195.383146:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787393195.383148:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4000, rc 0) 00000100:00100000:2.0:1787393195.383211:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+34:11535:x1874217319615104:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1442us (1735us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787393195.383218:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 195 00000100:00100000:0.0:1787393195.391460:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393195.391639:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319615232 00000100:00100000:3.0:1787393195.391650:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319615232 00000100:00100000:3.0:1787393195.391708:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 196 00000100:00100000:3.0:1787393195.391718:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+34:11535:x1874217319615232:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:3.0:1787393195.392248:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.392267:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f204d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d928 expref: 34 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.392285:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20a8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.392321:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f204d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d928 expref: 34 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.392347:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f204d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d928 expref: 34 pid: 5821 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393195.392372:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f68ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1874217338479488:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393195.392473:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787393195.396202:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393195.396305:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319615488 00000100:00100000:2.0:1787393195.396315:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319615488 00000100:00100000:3.0:1787393195.396438:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f68ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1874217338479488:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393195.396463:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393195.396484:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00100000:2.0:1787393195.396495:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+35:5566:x1874217319615488:12345-192.168.203.21@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787393195.397024:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+36:5566:x1874217319615488:12345-192.168.203.21@tcp:35:ldlm_bl.0 Request processed in 529us (828us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787393195.397033:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00100000:1.0:1787393195.400412:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393195.400501:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319615616 00000100:00100000:3.0:1787393195.400516:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319615616 00010000:00010000:3.0:1787393195.400553:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f204d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d928 expref: 36 pid: 5821 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393195.400591:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 75 00000100:00100000:3.0:1787393195.400601:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de806f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+36:2356:x1874217319615616:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787393195.400615:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393195.400622:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f204d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d928 expref: 36 pid: 5821 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.400636:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f204d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d928 expref: 36 pid: 5821 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.400656:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f204d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d928 expref: 36 pid: 5821 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.400689:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:3.0:1787393195.400695:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.400703:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.400711:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20a8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.400910:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393195.400964:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de806f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+35:2356:x1874217319615616:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 362us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393195.400972:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 75 00010000:00010000:2.0:1787393195.401137:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.401147:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.401181:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.401188:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.401202:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.401208:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393195.401213:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.401221:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.401231:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:2.0:1787393195.401234:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787393195.401238:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.401244:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393195.401286:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+34:11535:x1874217319615232:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 9569us (9835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393195.401295:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 196 00000100:00100000:1.0:1787393195.406828:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393195.406909:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319615872 00000100:00100000:3.0:1787393195.406919:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319615872 00000100:00100000:3.0:1787393195.406974:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 53 00000100:00100000:3.0:1787393195.406985:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+34:11535:x1874217319615872:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:3.0:1787393195.407507:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+35:11535:x1874217319615872:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 522us (685us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787393195.407516:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 53 00010000:00010000:1.0:1787393195.496061:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393195.514828:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393195.515123:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319616128 00000100:00100000:3.0:1787393195.515136:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319616128 00000100:00100000:3.0:1787393195.515216:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 197 00000100:00100000:3.0:1787393195.515228:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+35:11546:x1874217319616128:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:3.0:1787393195.515258:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393195.515301:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f20af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d944 expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.515400:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f20b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.515417:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f20b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.515431:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f20b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.515449:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.515457:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.515464:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.516908:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f20c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.516929:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f20c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.516941:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f20c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393195.516955:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787393195.517095:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f20b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.517118:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f20b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.517124:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f20b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.517131:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393195.517136:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f20b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.517144:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f20b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.517158:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:3.0:1787393195.517162:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393195.517167:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f20b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.517172:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f20b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.517189:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.517195:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.517201:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.517205:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393195.517216:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.517222:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.517230:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de8063da900) 00010000:00010000:3.0:1787393195.517233:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393195.517236:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.517241:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f20bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.517303:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f20af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d944 expref: 38 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.517319:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f20c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d944 expref: 37 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.517327:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:3.0:1787393195.517329:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787393195.517332:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800031c00, rc 0) 00000100:00100000:3.0:1787393195.517436:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+37:11546:x1874217319616128:12345-192.168.203.21@tcp:101:cat.0 Request processed in 2209us (2621us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787393195.517446:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 197 00000100:00100000:1.0:1787393195.525697:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393195.526943:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319616384 00000100:00100000:0.0:1787393195.526965:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319616384 00000100:00100000:0.0:1787393195.527185:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 54 00000100:00100000:0.0:1787393195.527199:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+37:11546:x1874217319616384:12345-192.168.203.21@tcp:35:cat.0 00000100:00100000:0.0:1787393195.527891:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+38:11546:x1874217319616384:12345-192.168.203.21@tcp:35:cat.0 Request processed in 682us (2194us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787393195.527903:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 54 00000100:00100000:1.0:1787393195.566958:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393195.567773:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319616640 00000100:00100000:2.0:1787393195.567790:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319616640 00000100:00100000:2.0:1787393195.567929:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 198 00000100:00100000:2.0:1787393195.567942:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+38:11547:x1874217319616640:12345-192.168.203.21@tcp:36:rm.0 00010000:00010000:2.0:1787393195.568029:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787393195.568078:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f20c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d944 expref: 38 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.568147:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f209a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d93d expref: 37 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.568160:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f2062 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d92f expref: 36 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.568172:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:2.0:1787393195.568186:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787393195.568214:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.568228:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.568240:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.568256:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f20d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.568530:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f20d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.568542:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f20d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.568995:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.569007:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.569022:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787393195.576997:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1787393195.577016:0:5820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344752175472ns, next at 345752170430ns, rc = 0 00010000:00010000:2.0:1787393195.577302:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f20e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577324:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f20e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577337:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f20e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577347:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f20e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577355:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f20e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577361:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f20e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577560:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787393195.577591:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577598:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577605:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577626:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393195.577631:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577667:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577681:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8900) 00010000:00010000:2.0:1787393195.577684:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787393195.577690:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577696:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577722:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577729:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577735:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577740:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393195.577743:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577749:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577769:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:2.0:1787393195.577772:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393195.577775:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.577781:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787393195.577791:0:5820:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000126bdea4 reply state 000000005aec09f3 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f20d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393195.577802:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787393195.581153:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+37:11547:x1874217319616640:12345-192.168.203.21@tcp:36:rm.0 Request processed in 13198us (14193us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787393195.581171:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 198 00010000:00010000:3.0:1787393195.582942:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393195.582960:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f20e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.583004:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5200 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393195.583010:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f20e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.583022:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f20e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.583055:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9de818bd8900) 00010000:00010000:3.0:1787393195.583059:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787393195.583065:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f20e7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.583070:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f20e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393195.583375:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393195.583378:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393195.583380:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393195.589395:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f20d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.589419:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f20d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.589428:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f20d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.589435:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393195.589441:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f20d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.589451:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f20d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.589500:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de818bd8d00) 00010000:00010000:2.0:1787393195.589504:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393195.589509:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f20d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.589517:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f20d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393195.661541:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393195.661698:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319616896 00000100:00100000:2.0:1787393195.661711:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319616896 00000100:00100000:2.0:1787393195.661778:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 199 00000100:00100000:2.0:1787393195.661788:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+36:11553:x1874217319616896:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1787393195.661827:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393195.661902:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f20ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d94b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.662085:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.662102:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.662115:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.662132:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.662139:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.662161:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787393195.662828:0:5821:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787393195.663077:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2103 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.663089:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.663099:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.663142:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.663149:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20f5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.663156:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.663162:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393195.663168:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.663177:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.663190:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:2.0:1787393195.663193:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393195.663207:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.663214:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f20f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787393195.663230:0:5821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000040d87ceb reply state 00000000c2d884f9 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393195.663240:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787393195.665159:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5c00/0x19a927d9c62f20ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d94b expref: 39 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.665207:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d94b expref: 38 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.665218:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:2.0:1787393195.665222:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787393195.665226:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4000, rc 0) 00000100:00100000:2.0:1787393195.665565:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+39:11553:x1874217319616896:12345-192.168.203.21@tcp:101:bash.0 Request processed in 3775us (4036us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787393195.665577:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 199 00010000:00010000:0.0:1787393195.669898:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.669923:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.669931:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.669937:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393195.669943:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.669952:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.669974:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de818bd8d00) 00010000:00010000:0.0:1787393195.669978:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393195.669983:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.670014:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f20fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393195.670718:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393195.670885:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319617024 00000100:00100000:0.0:1787393195.670898:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319617024 00000100:00080000:2.0:1787393195.670957:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787393195.670976:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:0.0:1787393195.670992:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2355:x1874217319617024:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:0.0:1787393195.671017:0:6625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393195.671043:0:6625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2111 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d952 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787393195.671075:0:6625:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393195.671100:0:6625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:0.0:1787393195.671105:0:6625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393195.671116:0:6625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2111 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d952 expref: 6 pid: 6625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.671135:0:6625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2111 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d952 expref: 6 pid: 6625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.671150:0:6625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761c800, rc 0) 00000100:00100000:0.0:1787393195.671234:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319617024:12345-192.168.203.21@tcp:101:bash.0 Request processed in 244us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393195.671243:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:1.0:1787393195.676652:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393195.676819:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319617152 00000100:00100000:2.0:1787393195.676834:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319617152 00000100:00100000:2.0:1787393195.676951:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:2.0:1787393195.676964:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:11553:x1874217319617152:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1787393195.676988:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393195.677021:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000932ba6d/0x19a927d9c62f2118 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d959 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.677091:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2111 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d952 expref: 7 pid: 6625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.677109:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787393195.677114:0:6624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787393195.677122:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000932ba6d/0x19a927d9c62f2118 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d959 expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.677164:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2111 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d952 expref: 7 pid: 6625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.677179:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2111 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d952 expref: 7 pid: 6625 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393195.677201:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8012aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6624:1874217338479616:192.168.203.21@tcp:104: 00000100:00100000:2.0:1787393195.677306:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501f540 going to sleep for 11 seconds 00000100:00100000:2.0:1787393195.682805:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393195.683197:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319617280 00000100:00100000:0.0:1787393195.683210:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319617280 00010000:00010000:0.0:1787393195.683279:0:11945:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2111 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d952 expref: 8 pid: 6625 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393195.683334:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 76 00000100:00100000:1.0:1787393195.683369:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2355:x1874217319617280:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393195.683391:0:11945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393195.683423:0:11945:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2111 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d952 expref: 8 pid: 6625 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393195.683440:0:11945:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2111 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d952 expref: 8 pid: 6625 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393195.683484:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393195.683489:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393195.683499:0:11945:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000932ba6d/0x19a927d9c62f2118 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d959 expref: 8 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393195.683511:0:11945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000932ba6d/0x19a927d9c62f2118 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d959 expref: 8 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393195.683729:0:11945:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000932ba6d/0x19a927d9c62f2118 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d959 expref: 8 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393195.683748:0:11945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca8c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11945:1874217338479744:192.168.203.21@tcp:105: 00000100:00100000:1.0:1787393195.684006:0:11945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83f6bc300 going to sleep for 11 seconds 00010000:00010000:3.0:1787393195.684291:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2111 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d952 expref: 8 pid: 6625 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393195.684310:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8012aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6624:1874217338479616:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393195.684501:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000932ba6d/0x19a927d9c62f2118 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d959 expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.685621:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4800, rc 0) 00000100:00100000:3.0:1787393195.685739:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:11553:x1874217319617152:12345-192.168.203.21@tcp:101:bash.0 Request processed in 8761us (9083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393195.685750:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:1.0:1787393195.687030:0:11945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca8c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11945:1874217338479744:192.168.203.21@tcp:105: 00010000:00010000:1.0:1787393195.687062:0:11945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393195.687122:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319617280:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 3776us (4330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393195.687135:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 76 00000100:00100000:1.0:1787393195.693574:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393195.693658:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319617536 00000100:00100000:3.0:1787393195.693689:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319617536 00000100:00100000:3.0:1787393195.693758:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00100000:3.0:1787393195.693770:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+38:11553:x1874217319617536:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:3.0:1787393195.694271:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+39:11553:x1874217319617536:12345-192.168.203.21@tcp:35:bash.0 Request processed in 501us (710us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787393195.694282:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00100000:2.0:1787393195.878744:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393195.879065:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319617664 00000100:00100000:3.0:1787393195.879080:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319617664 00000100:00100000:3.0:1787393195.879159:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 200 00000100:00100000:3.0:1787393195.879171:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+39:11569:x1874217319617664:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1787393195.879205:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393195.879233:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f211f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d960 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.879323:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f2126 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.879340:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f2126 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.879354:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f2126 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393195.879433:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787393195.879438:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787393195.879468:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f2126 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.879498:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f211f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d960 expref: 41 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.879546:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f2126 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d960 expref: 40 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.879557:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:3.0:1787393195.879560:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787393195.879569:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800030800, rc 0) 00000100:00100000:3.0:1787393195.879650:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+40:11569:x1874217319617664:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 481us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393195.879658:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 200 00000100:00100000:2.0:1787393195.884633:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393195.884746:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319617920 00000100:00100000:0.0:1787393195.884767:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319617920 00000100:00100000:0.0:1787393195.884901:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 201 00000100:00100000:0.0:1787393195.884913:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+40:11569:x1874217319617920:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1787393195.884940:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393195.884966:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f212d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d967 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.885111:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f2134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.885128:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f2134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.885143:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f2134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393195.885157:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787393195.885317:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761c800/0x19a927d9c62f212d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d967 expref: 43 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.885338:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f2134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d967 expref: 42 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.885347:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:0.0:1787393195.885363:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787393195.885368:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761de00, rc 0) 00000100:00100000:0.0:1787393195.885460:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+42:11569:x1874217319617920:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 549us (841us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787393195.885468:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 201 00000100:00100000:1.0:1787393195.888971:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393195.889035:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393195.889128:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319618304 00000100:00100000:2.0:1787393195.889141:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319618304 00000100:00100000:2.0:1787393195.889214:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 202 00000100:00100000:2.0:1787393195.889226:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+42:11569:x1874217319618304:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1787393195.889259:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393195.889309:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f2142 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d96e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.889461:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2149 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.889478:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2149 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.889491:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2149 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393195.889505:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787393195.889656:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4400/0x19a927d9c62f2142 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d96e expref: 45 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.889678:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2149 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d96e expref: 44 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.889686:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:2.0:1787393195.889689:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787393195.889692:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5a00, rc 0) 00000100:00100000:2.0:1787393195.889791:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+44:11569:x1874217319618304:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 567us (755us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787393195.889799:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 202 00000100:00100000:0.0:1787393195.890069:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319618048 00000100:00100000:0.0:1787393195.890075:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319618048 00000100:00100000:0.0:1787393195.890116:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:0.0:1787393195.890122:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+44:2355:x1874217319618048:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787393195.890133:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393195.890147:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f2134 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d967 expref: 44 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.890157:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:0.0:1787393195.890160:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393195.890181:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+43:2355:x1874217319618048:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 59us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393195.890187:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:2.0:1787393195.894587:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393195.894730:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319618432 00000100:00100000:3.0:1787393195.894743:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319618432 00000100:00100000:3.0:1787393195.894822:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00100000:3.0:1787393195.894834:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+6:2355:x1874217319618432:12345-192.168.203.21@tcp:1:lfs.0 00010000:00010000:3.0:1787393195.895205:0:7525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f20c3d5/0x19a927d9c62f2157 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.895232:0:7525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000932ba6d/0x19a927d9c62f2118 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d959 expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.895241:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787393195.895245:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787393195.895250:0:7525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f20c3d5/0x19a927d9c62f2157 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.895293:0:7525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000932ba6d/0x19a927d9c62f2118 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d959 expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.895380:0:7525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000932ba6d/0x19a927d9c62f2118 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d959 expref: 6 pid: 6624 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393195.895398:0:7525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f688000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7525:1874217338479872:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393195.895559:0:7525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787393195.898942:0:7525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f688000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7525:1874217338479872:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393195.898985:0:7525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007f20c3d5/0x19a927d9c62f2157 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393195.899919:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393195.900230:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319618560 00000100:00100000:3.0:1787393195.900242:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319618560 00002000:00100000:3.0:1787393195.900298:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9de8012adf80 x1874217319618560/t0(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:166/0 lens 504/0 e 0 to 0 dl 1787393206 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787393195.900307:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de8012adf80 with x1874217319618560 ext(0->8) 00010000:00010000:3.0:1787393195.900315:0:6630:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000932ba6d/0x19a927d9c62f2118 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d959 expref: 7 pid: 6624 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.900328:0:6630:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000932ba6d/0x19a927d9c62f2118 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d959 expref: 7 pid: 6624 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787393195.900338:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9de8012adf80 00000100:00100000:3.0:1787393195.900368:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:3.0:1787393195.900376:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2356:x1874217319618560:12345-192.168.203.21@tcp:4:lfs.0 00000100:00100000:3.0:1787393195.901225:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:2356:x1874217319618560:12345-192.168.203.21@tcp:4:lfs.0 Request processed in 844us (1308us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787393195.901234:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 3 00002000:00100000:3.0:1787393195.901241:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9de8012adf80 x1874217319618560/t4294967308(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:166/0 lens 504/448 e 0 to 0 dl 1787393206 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787393195.901258:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de8012adf80 with x1874217319618560 ext(0->8) 00010000:00010000:3.0:1787393195.901266:0:6630:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000932ba6d/0x19a927d9c62f2118 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d959 expref: 9 pid: 6624 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.901282:0:6630:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000932ba6d/0x19a927d9c62f2118 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d959 expref: 9 pid: 6624 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787393195.901289:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9de8012adf80 00000100:00100000:3.0:1787393195.905138:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393195.905380:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319618688 00000100:00100000:2.0:1787393195.905394:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319618688 00010000:00010000:2.0:1787393195.905449:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000932ba6d/0x19a927d9c62f2118 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d959 expref: 9 pid: 6624 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393195.905572:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 77 00000100:00100000:2.0:1787393195.905584:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f689500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:2353:x1874217319618688:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393195.905605:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787393195.905633:0:5807:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787393195.905636:0:5807:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787393196 00002000:00010000:2.0:1787393195.905639:0:5807:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787393196 00002000:00010000:2.0:1787393195.905641:0:5807:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787393196 00010000:00010000:2.0:1787393195.905648:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000932ba6d/0x19a927d9c62f2118 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d959 expref: 9 pid: 6624 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.905664:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000932ba6d/0x19a927d9c62f2118 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d959 expref: 9 pid: 6624 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.905697:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000932ba6d/0x19a927d9c62f2118 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d959 expref: 9 pid: 6624 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.905717:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787393195.905722:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787393195.905729:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007f20c3d5/0x19a927d9c62f2157 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.905740:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f20c3d5/0x19a927d9c62f2157 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393195.905790:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393195.905927:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f689500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2353:x1874217319618688:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 344us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393195.905940:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 77 00010000:00010000:3.0:1787393195.906002:0:7525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007f20c3d5/0x19a927d9c62f2157 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.906023:0:7525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f20c3d5/0x19a927d9c62f2157 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.906053:0:7525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f20c3d5/0x19a927d9c62f2157 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.906062:0:7525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f20c3d5/0x19a927d9c62f2157 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.906071:0:7525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f20c3d5/0x19a927d9c62f2157 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.906078:0:7525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031800 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393195.906091:0:7525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f20c3d5/0x19a927d9c62f2157 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.906102:0:7525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f20c3d5/0x19a927d9c62f2157 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.906118:0:7525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f20c3d5/0x19a927d9c62f2157 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.906127:0:7525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f20c3d5/0x19a927d9c62f2157 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393195.906187:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2355:x1874217319618432:12345-192.168.203.21@tcp:1:lfs.0 Request processed in 11355us (11615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393195.906196:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00100000:1.0:1787393195.908723:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393195.909004:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319618944 00000100:00100000:3.0:1787393195.909017:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319618944 00000100:00100000:3.0:1787393195.909208:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 56 00000100:00100000:3.0:1787393195.909217:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818e27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+43:11569:x1874217319618944:12345-192.168.203.21@tcp:35:lfs.0 00000004:00010000:3.0:1787393195.909298:0:5824:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2149 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d96e expref: 43 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787393195.909583:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787393195.909613:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787393195.910194:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787393195.910263:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f215e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.910307:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2103 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d94b expref: 47 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.910329:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f215e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.910373:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d94b expref: 47 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.910391:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2103 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d94b expref: 47 pid: 5821 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393195.910410:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f688e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5824:1874217338480000:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393195.910577:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787393195.916522:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393195.916547:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f688e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5824:1874217338480000:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393195.916584:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f215e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393195.916721:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319619072 00000100:00100000:0.0:1787393195.916731:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319619072 00010000:00010000:0.0:1787393195.916789:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2103 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d94b expref: 48 pid: 5821 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393195.916857:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 78 00000100:00100000:0.0:1787393195.916868:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+48:2355:x1874217319619072:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787393195.916895:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393195.916903:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2103 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d94b expref: 48 pid: 5821 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.916935:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d94b expref: 48 pid: 5821 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.916964:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2103 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d94b expref: 48 pid: 5821 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.916983:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:0.0:1787393195.916989:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f215e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.916999:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f215e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.917017:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f215e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.917042:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393195.918484:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+47:2355:x1874217319619072:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 241us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393195.918499:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 78 00010000:00010000:1.0:1787393195.918609:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f215e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393195.918620:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f215e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787393195.918796:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787393195.919682:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1787393195.920087:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83ca8dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5824:1874217338480128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787393195.920448:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393195.920553:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83f6bcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787393195.921270:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338480128 00000100:00100000:3.0:1787393195.921283:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338480128 00000100:00100000:3.0:1787393195.921405:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787393195.921418:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1874217338480128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787393195.921556:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1874217338480128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 140us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393195.921564:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787393195.921642:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83ca8dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5824:1874217338480128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787393195.922561:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1787393195.922667:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82cdb6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5824:1874217338480256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787393195.922728:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393195.922826:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83f6bc300 going to sleep for 11 seconds 00000100:00100000:0.0:1787393195.922832:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338480256 00000100:00100000:0.0:1787393195.923104:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338480256 00000100:00100000:1.0:1787393195.923212:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787393195.923222:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1874217338480256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787393195.923563:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5824:x1874217338480256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 342us (835us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787393195.923572:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787393195.923659:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82cdb6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5824:1874217338480256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787393195.923736:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1787393195.923787:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f215e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.923798:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f215e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.923806:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f215e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.923812:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800030c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393195.923817:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f215e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.923824:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f215e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.924041:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:3.0:1787393195.924046:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787393195.924052:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f215e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393195.924058:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f215e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787393195.924482:0:5824:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787393195.924778:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1787393195.924793:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345099953478ns, next at 346099949955ns, rc = 0 00000001:00080000:3.0:1787393195.924803:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1787393195.925204:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de818bd8e00) 00010000:00010000:3.0:1787393195.925210:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787393195.925234:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2149 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d96e expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393195.929550:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818e27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+50:11569:x1874217319618944:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 20306us (20812us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1787393195.929569:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 56 00000020:00080000:3.0:1787393195.929578:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787393195.935419:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393195.937575:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319619200 00000100:00100000:0.0:1787393195.937598:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319619200 00000100:00100000:0.0:1787393195.937768:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 203 00000100:00100000:0.0:1787393195.937781:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+50:11569:x1874217319619200:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1787393195.937812:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393195.937875:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f2165 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d975 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.937985:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f2165 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d975 expref: 51 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393195.938003:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f2165 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d975 expref: 51 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393195.938423:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:1.0:1787393195.938435:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787393195.938440:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761de00, rc 0) 00000100:00100000:1.0:1787393195.938542:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+51:11569:x1874217319619200:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 762us (3136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393195.938551:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 203 00000100:00100000:2.0:1787393195.944576:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393195.944745:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319619456 00000100:00100000:0.0:1787393195.944759:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319619456 00000100:00100000:0.0:1787393195.944977:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:0.0:1787393195.944991:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+51:11569:x1874217319619456:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1787393195.945993:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+52:11569:x1874217319619456:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 997us (1425us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787393195.946014:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:2.0:1787393196.020912:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393196.021221:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319619584 00000100:00100000:3.0:1787393196.021232:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319619584 00000100:00100000:3.0:1787393196.021349:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 204 00000100:00100000:3.0:1787393196.021360:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+52:11579:x1874217319619584:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:3.0:1787393196.021448:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f216c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021466:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f216c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021479:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f216c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021494:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2173 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021503:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021509:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021612:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f217a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021635:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f217a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021642:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f217a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787393196.021682:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f217a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021695:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f216c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021702:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f216c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021709:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f216c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021715:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393196.021719:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f216c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021726:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f216c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021737:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:3.0:1787393196.021740:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393196.021756:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f216c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021762:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f216c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021782:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021788:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2173 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021794:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021799:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800030c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393196.021802:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021809:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2173 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021817:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de8063da900) 00010000:00010000:3.0:1787393196.021819:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393196.021822:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2173 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021827:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2173 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021898:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f217a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021905:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f217a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021911:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f217a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021922:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393196.021925:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f217a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021931:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f217a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021938:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:3.0:1787393196.021940:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393196.021943:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f217a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.021948:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f217a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393196.022027:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+52:11579:x1874217319619584:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 668us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393196.022036:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 204 00000100:00100000:2.0:1787393196.071235:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393196.071357:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319619840 00000100:00100000:3.0:1787393196.071372:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319619840 00000100:00100000:3.0:1787393196.071446:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 205 00000100:00100000:3.0:1787393196.071458:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+52:11582:x1874217319619840:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1787393196.071487:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393196.071513:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f2181 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d97c expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.071622:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2188 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.071662:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2188 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.071677:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2188 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.071696:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f218f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.071705:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f218f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.071715:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f218f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.071939:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2196 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.071950:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.071959:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393196.071976:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787393196.072227:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2188 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.072236:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2188 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.072242:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2188 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.072249:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800030c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393196.072255:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2188 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.072263:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2188 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.072279:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:2.0:1787393196.072283:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393196.072289:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2188 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.072295:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2188 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.072312:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f218f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.072331:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f218f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.072337:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f218f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.072342:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393196.072345:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f218f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.072351:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f218f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.072360:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de8063da900) 00010000:00010000:2.0:1787393196.072363:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393196.072366:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f218f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.072372:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f218f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.072424:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f2181 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d97c expref: 55 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.072438:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d97c expref: 54 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.072445:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:2.0:1787393196.072448:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787393196.072457:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800031200, rc 0) 00000100:00100000:2.0:1787393196.072544:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:11582:x1874217319619840:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1088us (1321us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787393196.072554:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 205 00000100:00100000:0.0:1787393196.078919:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.079129:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319619968 00000100:00100000:1.0:1787393196.079144:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319619968 00000100:00100000:1.0:1787393196.079240:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 206 00000100:00100000:1.0:1787393196.079252:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:11582:x1874217319619968:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:1.0:1787393196.079324:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f21a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.079342:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f21a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.079355:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f21a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.079387:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f21a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.079394:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f21a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.079401:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f21a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.079431:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385bc00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393196.079628:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f21a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.079639:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f21a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.079652:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:1.0:1787393196.079655:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787393196.079660:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f21a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.079666:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f21a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393196.079758:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:11582:x1874217319619968:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 507us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393196.079767:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 206 00000100:00100000:3.0:1787393196.082358:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.082565:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319620224 00000100:00100000:1.0:1787393196.082576:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319620224 00000100:00100000:1.0:1787393196.082634:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00100000:1.0:1787393196.082645:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+54:11582:x1874217319620224:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1787393196.082927:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:11582:x1874217319620224:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 283us (575us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787393196.082935:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00100000:2.0:1787393196.159096:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.159206:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319620480 00000100:00100000:1.0:1787393196.159220:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319620480 00000100:00100000:1.0:1787393196.159293:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 207 00000100:00100000:1.0:1787393196.159333:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:11592:x1874217319620480:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:1.0:1787393196.159364:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393196.159368:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787393196.159405:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f2126 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d960 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.159431:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:1.0:1787393196.159437:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787393196.159454:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f21ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d983 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.159581:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.159598:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2196 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d97c expref: 55 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.159607:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21b2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.159807:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d97c expref: 55 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.159826:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2196 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d97c expref: 55 pid: 10433 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393196.160229:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82cdb6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1874217338480384:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393196.160363:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83f6bc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393196.163017:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82cdb6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1874217338480384:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393196.163059:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393196.163806:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.163925:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319620608 00000100:00100000:1.0:1787393196.163934:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319620608 00010000:00010000:1.0:1787393196.163982:0:11945:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2196 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d97c expref: 56 pid: 10433 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393196.164031:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 79 00000100:00100000:1.0:1787393196.164042:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83ca22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+56:2356:x1874217319620608:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393196.164059:0:11945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393196.164066:0:11945:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2196 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d97c expref: 56 pid: 10433 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.164079:0:11945:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d97c expref: 56 pid: 10433 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.164106:0:11945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2196 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d97c expref: 56 pid: 10433 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.164128:0:11945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:1.0:1787393196.164134:0:11945:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.164144:0:11945:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.164154:0:11945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21b2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.164208:0:11945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393196.164272:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83ca22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:2356:x1874217319620608:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 231us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393196.164281:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 79 00010000:00010000:3.0:1787393196.164447:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.164456:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393196.164494:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787393196.164686:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385bc00/0x19a927d9c62f21ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d983 expref: 56 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.164702:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d983 expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.164710:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:3.0:1787393196.164713:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787393196.164716:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385b000, rc 0) 00000100:00100000:3.0:1787393196.164758:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:11592:x1874217319620480:12345-192.168.203.21@tcp:101:bash.0 Request processed in 5428us (5677us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1787393196.164766:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 207 00000100:00100000:2.0:1787393196.168305:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393196.168449:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319620864 00000100:00100000:3.0:1787393196.168462:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319620864 00000100:00100000:3.0:1787393196.168557:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 208 00000100:00100000:3.0:1787393196.168569:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+55:11592:x1874217319620864:12345-192.168.203.21@tcp:36:bash.0 00010000:00010000:3.0:1787393196.168965:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f21c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.168986:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f21c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.169000:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f21c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787393196.169133:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1787393196.169190:0:5822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001b3a6ed4 reply state 00000000261db888 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f21c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393196.169201:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787393196.169625:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+58:11592:x1874217319620864:12345-192.168.203.21@tcp:36:bash.0 Request processed in 1056us (1329us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1787393196.169636:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 208 00000020:00080000:3.0:1787393196.169642:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787393196.173341:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00010000:00010000:2.0:1787393196.173449:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f21c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.173465:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f21c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.173473:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f21c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.173481:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393196.173486:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f21c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.173494:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f21c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.173518:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:2.0:1787393196.173522:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393196.173527:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f21c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.173533:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f21c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393196.174110:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319620992 00000100:00100000:3.0:1787393196.174124:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319620992 00000100:00100000:3.0:1787393196.174242:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 209 00000100:00100000:3.0:1787393196.174256:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+57:11592:x1874217319620992:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1787393196.174292:0:10433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393196.174316:0:10433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f21c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d98a expref: -99 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.174425:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f21ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.174441:0:10433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21b2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d983 expref: 58 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.174450:0:10433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f21ce lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.174491:0:10433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d983 expref: 58 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.174506:0:10433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d983 expref: 58 pid: 5821 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393196.174544:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f68ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338480512:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393196.174657:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1480 going to sleep for 11 seconds 00000100:00100000:3.0:1787393196.176776:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f68ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338480512:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393196.176818:0:10433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f21ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393196.182432:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393196.182764:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319621120 00000100:00100000:3.0:1787393196.182779:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319621120 00010000:00010000:3.0:1787393196.182834:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d983 expref: 59 pid: 5821 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393196.183260:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 80 00000100:00100000:0.0:1787393196.183274:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+59:2354:x1874217319621120:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787393196.183295:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393196.183304:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d983 expref: 59 pid: 5821 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.183331:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d983 expref: 59 pid: 5821 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.183360:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d983 expref: 59 pid: 5821 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.183381:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:0.0:1787393196.183387:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f21ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.183414:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f21ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.183423:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f21ce lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.183464:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393196.183534:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+58:2354:x1874217319621120:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 263us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393196.183543:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 80 00010000:00010000:1.0:1787393196.185319:0:10433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f21ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.185337:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f21ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393196.185404:0:10433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787393196.185410:0:10433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393196.185439:0:10433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f21ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.185495:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f21c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d98a expref: 58 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.185520:0:10433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f21ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d98a expref: 57 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.185530:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:1.0:1787393196.185534:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393196.185537:0:10433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800030800, rc 0) 00000100:00100000:1.0:1787393196.185620:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+57:11592:x1874217319620992:12345-192.168.203.21@tcp:101:bash.0 Request processed in 11367us (12303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393196.185650:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 209 00000100:00100000:1.0:1787393196.188768:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393196.188899:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319621376 00000100:00100000:2.0:1787393196.188928:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319621376 00000100:00100000:2.0:1787393196.189458:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 59 00000100:00100000:2.0:1787393196.189470:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+57:11592:x1874217319621376:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:2.0:1787393196.189800:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+58:11592:x1874217319621376:12345-192.168.203.21@tcp:35:bash.0 Request processed in 331us (1055us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787393196.189808:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 59 00000100:00100000:3.0:1787393196.253920:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.254122:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319621504 00000100:00100000:1.0:1787393196.254136:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319621504 00000100:00100000:1.0:1787393196.254207:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 210 00000100:00100000:1.0:1787393196.254220:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f68ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+58:11598:x1874217319621504:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393196.254257:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393196.254285:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f21d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d991 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.254386:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f21dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.254403:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f21dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.254417:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f21dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393196.254495:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787393196.254498:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393196.254525:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f21dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.254554:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f21d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d991 expref: 60 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.254575:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f21dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d991 expref: 59 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.254609:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:1.0:1787393196.254613:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787393196.254617:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385be00, rc 0) 00000100:00100000:1.0:1787393196.254704:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f68ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+59:11598:x1874217319621504:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 486us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393196.254713:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 210 00000100:00100000:0.0:1787393196.257682:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.257788:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319621632 00000100:00100000:1.0:1787393196.257801:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319621632 00000100:00100000:1.0:1787393196.257894:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 211 00000100:00100000:1.0:1787393196.257908:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+59:11598:x1874217319621632:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393196.258055:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393196.258084:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f21e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d998 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.258242:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f21ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.258259:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f21ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.258272:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f21ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.258291:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f21f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.258298:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f21f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.258326:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f21f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.258454:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.258464:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.258471:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393196.258517:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787393196.258521:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393196.258543:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.258558:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.258568:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f21ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.258575:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f21ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.258582:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f21ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.258588:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393196.258593:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f21ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.258609:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f21ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.258623:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:1.0:1787393196.258626:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393196.258632:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f21ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.258637:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f21ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.260479:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f21f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.260490:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f21f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.260498:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f21f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.260505:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385ac00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393196.260510:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f21f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.260519:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f21f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.260536:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de80398fb00) 00010000:00010000:1.0:1787393196.260540:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393196.260545:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f21f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.260575:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ac00/0x19a927d9c62f21f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.260638:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a200/0x19a927d9c62f21e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d998 expref: 61 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.260654:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d998 expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.260663:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:1.0:1787393196.260665:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393196.260668:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385b000, rc 0) 00000100:00100000:1.0:1787393196.260827:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:11598:x1874217319621632:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 2920us (3159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393196.260868:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 211 00000100:00100000:2.0:1787393196.267543:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393196.267669:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.267760:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319621760 00000100:00100000:1.0:1787393196.267774:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319621760 00000100:00100000:1.0:1787393196.267900:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:1.0:1787393196.267913:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de806f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:2356:x1874217319621760:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393196.267941:0:11945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787393196.267951:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319622016 00000100:00100000:3.0:1787393196.267956:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319622016 00010000:00010000:1.0:1787393196.267973:0:11945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f21f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d998 expref: 61 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393196.267987:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 212 00000100:00100000:3.0:1787393196.267993:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:11598:x1874217319622016:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393196.267997:0:11945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:1.0:1787393196.268002:0:11945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787393196.268012:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787393196.268064:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de806f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:2356:x1874217319621760:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 155us (535us total) trans 0 rc 0/0 00010000:00010000:3.0:1787393196.268105:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f21ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d99f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393196.268172:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 16 00010000:00010000:3.0:1787393196.268233:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f2206 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.268249:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f21ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d98a expref: 60 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.268865:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f2206 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.268925:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f21ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d98a expref: 60 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.268952:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f21ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d98a expref: 60 pid: 10433 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393196.268969:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f68b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1874217338480640:192.168.203.21@tcp:104: 00000100:00100000:2.0:1787393196.269737:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787393196.274229:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f68b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1874217338480640:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393196.274298:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f2206 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393196.274474:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393196.274569:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319622144 00000100:00100000:0.0:1787393196.274588:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319622144 00010000:00010000:0.0:1787393196.274634:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f21ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d98a expref: 61 pid: 10433 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393196.274679:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 81 00000100:00100000:0.0:1787393196.274688:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+61:2355:x1874217319622144:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787393196.274704:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393196.274710:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f21ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d98a expref: 61 pid: 10433 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.274719:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f21ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d98a expref: 61 pid: 10433 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.274742:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f21ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d98a expref: 61 pid: 10433 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.275229:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:0.0:1787393196.275234:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f2206 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.275245:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f2206 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.275253:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f2206 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.275293:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393196.275369:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:2355:x1874217319622144:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 679us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393196.275380:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 81 00010000:00010000:1.0:1787393196.275739:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f2206 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.275747:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f2206 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393196.275783:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787393196.276039:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f21ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d99f expref: 61 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.276060:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f2206 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d99f expref: 60 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.276069:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:1.0:1787393196.276071:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787393196.276075:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800031a00, rc 0) 00000100:00100000:1.0:1787393196.276957:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:11598:x1874217319622016:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 8956us (9280us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787393196.276968:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 212 00000100:00100000:2.0:1787393196.284536:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.284631:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319622400 00000100:00100000:1.0:1787393196.284644:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319622400 00000100:00100000:1.0:1787393196.284767:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:1.0:1787393196.284779:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:11598:x1874217319622400:12345-192.168.203.21@tcp:103:lfs.0 00010000:00010000:1.0:1787393196.284816:0:11945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393196.284888:0:11945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f2165 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d975 expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.284913:0:11945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:1.0:1787393196.284919:0:11945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393196.284996:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+59:11598:x1874217319622400:12345-192.168.203.21@tcp:103:lfs.0 Request processed in 218us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393196.285014:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:2.0:1787393196.290715:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393196.291198:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319622528 00000100:00100000:3.0:1787393196.291211:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319622528 00000100:00100000:3.0:1787393196.291287:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 213 00000100:00100000:3.0:1787393196.291299:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+59:11598:x1874217319622528:12345-192.168.203.21@tcp:58:lfs.0 00010000:00010000:3.0:1787393196.291458:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2214 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.291480:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2214 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.291494:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2214 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787393196.291733:0:10433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1787393196.292358:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+59:11598:x1874217319622528:12345-192.168.203.21@tcp:58:lfs.0 Request processed in 1054us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393196.292371:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 213 00000100:00100000:0.0:1787393196.297345:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.297416:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319622656 00000100:00100000:1.0:1787393196.297432:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319622656 00000100:00100000:1.0:1787393196.297506:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 214 00000100:00100000:1.0:1787393196.297519:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+59:11598:x1874217319622656:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393196.297546:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393196.297571:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f221b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d9a6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.297645:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2214 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.297657:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f221b lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9a6 expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.297680:0:5822:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2214 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.297695:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f221b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9a6 expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.297734:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:1.0:1787393196.297738:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787393196.297743:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f221b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9a6 expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.297763:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385b000, rc 0) 00000100:00100000:1.0:1787393196.297901:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:11598:x1874217319622656:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 384us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393196.297910:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 214 00010000:00010000:1.0:1787393196.520535:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787393196.712407:0:11566:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787393196.712421:0:11566:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787393196.712479:0:11566:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787393196.712487:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787393196.713638:0:11566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82cdb7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11566:1874217338480768:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787393196.714042:0:11566:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83f6bc540 going to sleep for 11 seconds 00000100:00100000:0.0:1787393196.720329:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.720495:0:11566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82cdb7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11566:1874217338480768:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787393196.720901:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319622784 00000100:00100000:3.0:1787393196.720911:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319622784 00000100:00100000:3.0:1787393196.720980:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 215 00000100:00100000:3.0:1787393196.720991:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:11599:x1874217319622784:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787393196.721067:0:5821:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787393196.721210:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:11599:x1874217319622784:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 219us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393196.721219:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 215 00000100:00100000:2.0:1787393196.725383:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393196.728887:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319622912 00000100:00100000:3.0:1787393196.728909:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319622912 00000100:00100000:3.0:1787393196.729055:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 216 00000100:00100000:3.0:1787393196.729068:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:11599:x1874217319622912:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787393196.729430:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f2222 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.729457:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f2222 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.729471:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f2222 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.731542:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f2229 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.731568:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f2229 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.731582:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f2229 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.731637:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2230 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.731647:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.731654:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393196.733191:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787393196.733200:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787393196.733220:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733236:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f2222 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733243:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f2222 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733250:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f2222 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733256:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393196.733261:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f2222 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733269:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f2222 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733284:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9de8184fc100) 00010000:00010000:3.0:1787393196.733304:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393196.733309:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f2222 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733316:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031800/0x19a927d9c62f2222 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733335:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f2229 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733342:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f2229 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733348:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f2229 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733354:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800030800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393196.733357:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f2229 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733363:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f2229 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733371:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9de8063da400) 00010000:00010000:3.0:1787393196.733374:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393196.733377:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f2229 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733382:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f2229 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733400:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733413:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2230 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733418:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733422:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393196.733426:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733432:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2230 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733440:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:3.0:1787393196.733442:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393196.733444:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2230 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.733449:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f2230 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393196.734815:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:11599:x1874217319622912:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 Request processed in 5740us (9438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393196.734829:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 216 00000100:00100000:2.0:1787393196.740164:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393196.741550:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319623168 00000100:00100000:3.0:1787393196.741563:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319623168 00000100:00100000:2.0:1787393196.743609:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 217 00000100:00100000:2.0:1787393196.744051:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+60:11599:x1874217319623168:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787393196.744076:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393196.744106:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f2237 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d9ad expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.744220:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f223e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.744234:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f223e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.744246:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f223e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393196.744277:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787393196.744378:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f223e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.744385:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f223e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.744391:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f223e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.744397:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393196.744401:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f223e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.744407:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f223e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.744418:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:2.0:1787393196.744422:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787393196.744425:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f223e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.744431:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f223e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.744468:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f2237 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9ad expref: 62 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.744479:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9de8184fc100) 00010000:00010000:2.0:1787393196.744482:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787393196.744492:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f2237 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9ad expref: 62 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.744502:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4e00, rc 0) 00000100:00100000:2.0:1787393196.744582:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+61:11599:x1874217319623168:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 552us (4428us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1787393196.744590:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 217 00000100:00100000:0.0:1787393196.749027:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.749182:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319623296 00000100:00100000:1.0:1787393196.749200:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319623296 00000100:00100000:1.0:1787393196.749285:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 218 00000100:00100000:1.0:1787393196.749300:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+61:11599:x1874217319623296:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787393196.749351:0:10433:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787393196.750004:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+61:11599:x1874217319623296:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 705us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393196.750037:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 218 00000100:00100000:1.0:1787393196.754615:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393196.757283:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319623552 00000100:00100000:2.0:1787393196.757308:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319623552 00000100:00100000:2.0:1787393196.757434:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 219 00000100:00100000:2.0:1787393196.757448:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+61:11599:x1874217319623552:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787393196.757478:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393196.757481:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787393196.757620:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385be00/0x19a927d9c62f21dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d991 expref: 61 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.757645:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:2.0:1787393196.757651:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787393196.757670:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f224c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d9b4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787393196.758385:0:5820:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1787393196.758836:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f2253 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.758909:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f2253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.758923:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f2253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.759019:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4e00/0x19a927d9c62f224c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9b4 expref: 63 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.759039:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f2253 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9b4 expref: 62 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.759048:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:2.0:1787393196.759051:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787393196.759055:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5200, rc 0) 00000100:00100000:2.0:1787393196.759140:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+62:11599:x1874217319623552:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 1695us (4538us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787393196.759151:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 219 00000100:00100000:2.0:1787393196.763199:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393196.763694:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319623808 00000100:00100000:3.0:1787393196.763708:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319623808 00000100:00100000:3.0:1787393196.763795:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 220 00000100:00100000:3.0:1787393196.763809:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+62:11599:x1874217319623808:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787393196.764317:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393196.764358:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f2253 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9b4 expref: 62 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.764382:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9de818bd8000) 00010000:00010000:2.0:1787393196.764394:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787393196.764687:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2261 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.764703:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2261 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.764715:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2261 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.764952:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f2268 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x8834b21a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.764977:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f2268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8834b21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.764989:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f2268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8834b21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.765081:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2261 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.765089:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2261 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.765095:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2261 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.765101:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393196.765105:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2261 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.765112:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2261 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.765124:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:2.0:1787393196.765128:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393196.765132:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2261 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.765138:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f2261 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.765166:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f2268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8834b21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.765250:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f2268 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8834b21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.765259:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f2268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8834b21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.765264:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393196.765267:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f2268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8834b21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.765274:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f2268 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8834b21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.765340:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x8834b21a (ffff9de818bd8c00) 00010000:00010000:2.0:1787393196.765343:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393196.765346:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f2268 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8834b21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.765352:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5400/0x19a927d9c62f2268 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8834b21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393196.765463:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+61:11599:x1874217319623808:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 1654us (2376us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787393196.765472:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 220 00000100:00100000:0.0:1787393196.769538:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.769648:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319623936 00000100:00100000:1.0:1787393196.769658:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319623936 00000100:00100000:1.0:1787393196.769746:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 221 00000100:00100000:1.0:1787393196.769756:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+61:11599:x1874217319623936:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787393196.769776:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393196.769797:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f226f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d9bb expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.769829:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f2276 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.769881:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f2276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.769893:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f2276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.769987:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f226f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9bb expref: 63 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.770006:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f2276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9bb expref: 62 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.770014:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9de80398fb00) 00010000:00010000:1.0:1787393196.770017:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787393196.770020:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385a600, rc 0) 00000100:00100000:1.0:1787393196.770087:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+62:11599:x1874217319623936:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 332us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393196.770095:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 221 00000100:00100000:1.0:1787393196.775512:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393196.775596:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319624192 00000100:00100000:3.0:1787393196.775612:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319624192 00000100:00100000:3.0:1787393196.775704:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 222 00000100:00100000:3.0:1787393196.775717:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+62:11599:x1874217319624192:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787393196.776301:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f227d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.776324:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f227d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.776338:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f227d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787393196.776960:0:10433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1787393196.776974:0:10433:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 345952134020ns, next at 346952130392ns, rc = 0 00000004:00010000:2.0:1787393196.777089:0:10433:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007bab005e reply state 00000000328f68db transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f227d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393196.777116:0:10433:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787393196.777250:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+64:11599:x1874217319624192:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 1532us (1743us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787393196.777260:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 222 00000100:00100000:2.0:1787393196.781057:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.781136:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319624320 00000100:00100000:1.0:1787393196.781150:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319624320 00000100:00100000:1.0:1787393196.781217:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 223 00000100:00100000:1.0:1787393196.781226:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+64:11599:x1874217319624320:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787393196.781248:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393196.781268:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f2284 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d9c2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.781330:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f2284 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9c2 expref: 65 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.781345:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f2284 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9c2 expref: 65 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.781368:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9de80398fb00) 00010000:00010000:1.0:1787393196.781371:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787393196.781374:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385a000, rc 0) 00000100:00100000:1.0:1787393196.781442:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+65:11599:x1874217319624320:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 217us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393196.781449:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 223 00010000:00010000:0.0:1787393196.781485:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f227d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.781501:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f227d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.781510:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f227d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.781518:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393196.781525:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f227d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.781554:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f227d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.781574:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9de80398fb00) 00010000:00010000:0.0:1787393196.781577:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787393196.781583:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f227d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.781590:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f227d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393196.787970:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393196.788247:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319624448 00000100:00100000:3.0:1787393196.788261:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319624448 00000100:00100000:3.0:1787393196.788338:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:3.0:1787393196.788350:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:2356:x1874217319624448:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787393196.789094:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:2356:x1874217319624448:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 743us (1136us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787393196.789105:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:2.0:1787393196.793551:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.793664:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319624704 00000100:00100000:1.0:1787393196.793678:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319624704 00000100:00100000:1.0:1787393196.793748:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:1.0:1787393196.793760:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+64:11599:x1874217319624704:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787393196.794078:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+65:11599:x1874217319624704:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 319us (539us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787393196.794086:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:0.0:1787393196.796524:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393196.796634:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319624960 00000100:00100000:2.0:1787393196.796647:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319624960 00000100:00100000:2.0:1787393196.796718:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 224 00000100:00100000:2.0:1787393196.796729:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+65:11599:x1874217319624960:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787393196.797173:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+65:11599:x1874217319624960:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 444us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393196.797184:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 224 00000100:00100000:0.0:1787393196.801215:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393196.801406:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319625088 00000100:00100000:2.0:1787393196.801419:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319625088 00000100:00100000:2.0:1787393196.801565:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 225 00000100:00100000:2.0:1787393196.801579:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+65:11599:x1874217319625088:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787393196.801606:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393196.801630:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f228b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d9c9 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.801720:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f2292 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.801737:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f2292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.801785:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f2292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393196.801835:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787393196.802129:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f2292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.802161:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f228b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9c9 expref: 67 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.802181:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f2292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9c9 expref: 66 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.802191:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9de80398fb00) 00010000:00010000:2.0:1787393196.802194:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787393196.802199:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5200, rc 0) 00000100:00100000:2.0:1787393196.802276:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+66:11599:x1874217319625088:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 701us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393196.802284:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 225 00000100:00100000:1.0:1787393196.805992:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393196.806164:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319625216 00000100:00100000:0.0:1787393196.806178:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319625216 00000100:00100000:0.0:1787393196.806251:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:0.0:1787393196.806262:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+10:2355:x1874217319625216:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787393196.806285:0:6625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393196.806309:0:6625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2299 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d9d0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787393196.806342:0:6625:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8974ad, blocks: 0x1 00010000:00010000:0.0:1787393196.806365:0:6625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1787393196.806370:0:6625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393196.806380:0:6625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d0 expref: 11 pid: 6625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.806421:0:6625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d0 expref: 11 pid: 6625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.806436:0:6625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761c800, rc 0) 00000100:00100000:0.0:1787393196.806599:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+11:2355:x1874217319625216:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 338us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393196.806608:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:0.0:1787393196.810309:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.810395:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319625472 00000100:00100000:1.0:1787393196.810408:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319625472 00000100:00100000:1.0:1787393196.810510:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 226 00000100:00100000:1.0:1787393196.810522:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83524f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+66:11599:x1874217319625472:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787393196.810669:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83524f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+66:11599:x1874217319625472:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 148us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393196.810678:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 226 00000100:00100000:2.0:1787393196.813732:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393196.813820:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319625600 00000100:00100000:3.0:1787393196.813834:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319625600 00000100:00100000:3.0:1787393196.813946:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:3.0:1787393196.813958:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+11:11599:x1874217319625600:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787393196.813981:0:6622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393196.814017:0:6622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d425c22/0x19a927d9c62f22a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d9d7 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.814080:0:6622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2299 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d0 expref: 12 pid: 6625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.814090:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393196.814095:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393196.814101:0:6622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d425c22/0x19a927d9c62f22a0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d7 expref: 12 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.814140:0:6622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d0 expref: 12 pid: 6625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.814156:0:6622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2299 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d0 expref: 12 pid: 6625 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393196.814172:0:6622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f689f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6622:1874217338480896:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393196.814271:0:6622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de820044780 going to sleep for 11 seconds 00000100:00100000:0.0:1787393196.816419:0:6622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f689f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6622:1874217338480896:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787393196.816467:0:6622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007d425c22/0x19a927d9c62f22a0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d7 expref: 12 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.816493:0:6622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800030800, rc 0) 00000100:00100000:0.0:1787393196.816616:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+12:11599:x1874217319625600:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 2660us (2896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393196.816626:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:0.0:1787393196.820505:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393196.820906:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319625728 00000100:00100000:2.0:1787393196.820922:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319625728 00010000:00010000:2.0:1787393196.820977:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2299 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d0 expref: 12 pid: 6625 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393196.821032:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 82 00000100:00100000:2.0:1787393196.821044:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+12:2356:x1874217319625728:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393196.821082:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393196.821112:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2299 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d0 expref: 12 pid: 6625 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.821129:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d0 expref: 12 pid: 6625 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.821159:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2299 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d0 expref: 12 pid: 6625 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.821179:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787393196.821194:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787393196.821204:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d425c22/0x19a927d9c62f22a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d7 expref: 11 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.821216:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d425c22/0x19a927d9c62f22a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d7 expref: 11 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.821262:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007d425c22/0x19a927d9c62f22a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d7 expref: 11 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393196.821276:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834d42300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5806:1874217338481024:192.168.203.21@tcp:105: 00000100:00100000:2.0:1787393196.821399:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787393196.826731:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834d42300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5806:1874217338481024:192.168.203.21@tcp:105: 00010000:00010000:0.0:1787393196.826784:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393196.827347:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+11:2356:x1874217319625728:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 6301us (6852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393196.827362:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 82 00000100:00100000:3.0:1787393196.827542:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393196.827707:0:6629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319625856 00000100:00100000:0.0:1787393196.827734:0:6629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319625856 00002000:00100000:0.0:1787393196.827799:0:6629:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9de83f68b100 x1874217319625856/t0(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:167/0 lens 504/0 e 0 to 0 dl 1787393207 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787393196.827811:0:6629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de83f68b100 with x1874217319625856 ext(0->12) 00002000:00010000:0.0:1787393196.827818:0:6629:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de83f68b100 00000100:00100000:0.0:1787393196.828031:0:6629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:0.0:1787393196.828043:0:6629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f68b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+11:2355:x1874217319625856:12345-192.168.203.21@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787393196.828586:0:6629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f68b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:2355:x1874217319625856:12345-192.168.203.21@tcp:4:lhsmtool_posix.0 Request processed in 542us (1042us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787393196.828597:0:6629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00002000:00100000:0.0:1787393196.828603:0:6629:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9de83f68b100 x1874217319625856/t4294967321(0) o4->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:167/0 lens 504/448 e 0 to 0 dl 1787393207 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787393196.828612:0:6629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de83f68b100 with x1874217319625856 ext(0->12) 00002000:00010000:0.0:1787393196.828617:0:6629:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de83f68b100 00000100:00100000:3.0:1787393196.831758:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.831900:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319625984 00000100:00100000:1.0:1787393196.831914:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319625984 00000100:00100000:1.0:1787393196.831980:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 227 00000100:00100000:1.0:1787393196.831992:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+66:11599:x1874217319625984:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787393196.875417:0:12401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967484 is committed 00000001:00080000:1.0:1787393196.875455:0:12401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:1.0:1787393196.875474:0:12401:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9de83f6bcd80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787393196.875480:0:12401:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9de80765f900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9de83f6bca80 00000020:00080000:1.0:1787393196.875484:0:12401:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9de80765f800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9de82d21d400 00000020:00080000:1.0:1787393196.875532:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000004:00080000:3.0:1787393196.875690:0:12402:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1787393196.875735:0:12402:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1787393196.875763:0:12402:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:3.0:1787393196.875793:0:12402:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1787393196.875829:0:12402:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9de8351c2b40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787393196.875833:0:12402:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9de83ca19d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9de8351c2cc0 00000020:00080000:3.0:1787393196.875836:0:12402:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9de83ca19200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9de834d7bc00 00000100:00100000:3.0:1787393196.876083:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338481152:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787393196.876177:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787393196.876255:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787393196.876450:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787393196.876468:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338481152 00000100:00100000:3.0:1787393196.876477:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338481152 00000100:00100000:3.0:1787393196.876535:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787393196.876546:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f68b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3324:x1874217338481152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787393196.876580:0:7525:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1787393196.876625:0:7525:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8974ac, atime: 0x6a8974ac, ctime: 0x6a8974ac, blocks: 0x1 00010000:00010000:3.0:1787393196.876636:0:7525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf7d0b3/0x19a927d9c62f22a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.876658:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1787393196.876663:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393196.876670:0:7525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf7d0b3/0x19a927d9c62f22a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.876688:0:7525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdf7d0b3/0x19a927d9c62f22a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.876699:0:7525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf7d0b3/0x19a927d9c62f22a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.876707:0:7525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf7d0b3/0x19a927d9c62f22a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.876741:0:7525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787393196.877295:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f68b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3324:x1874217338481152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 748us (1115us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787393196.877304:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:3.0:1787393196.877335:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393196.877343:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdf7d0b3/0x19a927d9c62f22a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.877352:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031c00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393196.877358:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf7d0b3/0x19a927d9c62f22a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.877368:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf7d0b3/0x19a927d9c62f22a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.877389:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdf7d0b3/0x19a927d9c62f22a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.877397:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdf7d0b3/0x19a927d9c62f22a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.877419:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393196.877421:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393196.877423:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787393196.877459:0:3324:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9de83f689f80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787393196.877467:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338481152:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787393196.878784:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82cdb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338481408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787393196.878885:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393196.878952:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338481408 00000100:00100000:1.0:1787393196.878974:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338481408 00000100:00100000:1.0:1787393196.879046:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787393196.879054:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3326:x1874217338481408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787393196.879463:0:6624:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787393196.879467:0:6624:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787393197 00002000:00010000:1.0:1787393196.879470:0:6624:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787393196.879472:0:6624:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787393197 -> 1787393197 00002000:00010000:1.0:1787393196.879474:0:6624:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787393196.879529:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3326:x1874217338481408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 473us (643us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1787393196.879537:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1787393196.879566:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787393196.879603:0:3326:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9de82cdb4000/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787393196.879611:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82cdb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338481408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787393196.879626:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787393196.879635:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82cdb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338481280:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787393196.879666:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393196.879703:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338481280 00000100:00100000:1.0:1787393196.879707:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338481280 00000100:00100000:1.0:1787393196.879733:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787393196.879740:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3324:x1874217338481280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787393196.879829:0:6622:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1787393196.879951:0:6622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1c86c28/0x19a927d9c62f22ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.879977:0:6622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f2069 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d936 expref: 12 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.880073:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787393196.880078:0:6622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787393196.880084:0:6622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1c86c28/0x19a927d9c62f22ae lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.880568:0:6622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f2069 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d936 expref: 12 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.880592:0:6622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f2069 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d936 expref: 12 pid: 6624 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393196.880609:0:6622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de82cdb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6622:1874217338481536:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393196.880704:0:6622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de806efef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787393196.886528:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:11599:x1874217319625984:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 Request processed in 54523us (54783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393196.886546:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 227 00000100:00100000:3.0:1787393196.887922:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393196.888085:0:6622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82cdb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6622:1874217338481536:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787393196.888133:0:6622:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f1c86c28/0x19a927d9c62f22ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393196.888561:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319626112 00000100:00100000:2.0:1787393196.888572:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319626112 00010000:00010000:2.0:1787393196.888620:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f2069 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d936 expref: 13 pid: 6624 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393196.888681:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 83 00000100:00100000:2.0:1787393196.888693:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f689500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+13:2356:x1874217319626112:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393196.888713:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393196.888719:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f2069 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d936 expref: 13 pid: 6624 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.888735:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f2069 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d936 expref: 13 pid: 6624 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.888766:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087900090/0x19a927d9c62f2069 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d936 expref: 13 pid: 6624 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.888786:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787393196.888791:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787393196.888797:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1c86c28/0x19a927d9c62f22ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.888809:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1c86c28/0x19a927d9c62f22ae lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.888835:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787393196.889090:0:6622:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f1c86c28/0x19a927d9c62f22ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.889118:0:6622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1c86c28/0x19a927d9c62f22ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.889145:0:6622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1c86c28/0x19a927d9c62f22ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.889154:0:6622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1c86c28/0x19a927d9c62f22ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.889176:0:6622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787393196.889825:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3324:x1874217338481280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10080us (10153us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1787393196.889837:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:0.0:1787393196.895788:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393196.895808:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1c86c28/0x19a927d9c62f22ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.895826:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a400 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393196.895832:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1c86c28/0x19a927d9c62f22ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.895862:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1c86c28/0x19a927d9c62f22ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.897054:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1c86c28/0x19a927d9c62f22ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.897085:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1c86c28/0x19a927d9c62f22ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.897370:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393196.897374:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393196.897377:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393196.897666:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f689500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+12:2356:x1874217319626112:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 8964us (9744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393196.897682:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 83 00000004:00080000:0.0:1787393196.898117:0:3324:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9de82cdb6300/2, rc 0, transno 4294967323 00000100:00100000:0.0:1787393196.898137:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de82cdb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338481280:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787393196.900977:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.901036:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319626240 00000100:00100000:1.0:1787393196.901052:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319626240 00000100:00100000:1.0:1787393196.901117:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:1.0:1787393196.901127:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+12:2356:x1874217319626240:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787393196.931150:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1787393196.931173:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1787393196.931479:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2356:x1874217319626240:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 Request processed in 30344us (30506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393196.931493:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:1.0:1787393196.934699:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393196.934895:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319626496 00000100:00100000:2.0:1787393196.934911:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319626496 00000100:00100000:2.0:1787393196.934975:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 228 00000100:00100000:2.0:1787393196.934987:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:11599:x1874217319626496:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787393196.935073:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393196.935111:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5200/0x19a927d9c62f2292 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9c9 expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.935135:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9de80398fb00) 00010000:00010000:2.0:1787393196.935141:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787393196.935181:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f22b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.935197:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f22b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.935207:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f22b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787393196.935639:0:5822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cfb42b89 reply state 00000000d25a7ad6 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f22b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393196.935652:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787393196.936340:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:11599:x1874217319626496:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 1347us (1644us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787393196.936351:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 228 00000100:00100000:2.0:1787393196.940422:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.941213:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319626624 00000100:00100000:1.0:1787393196.941228:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319626624 00000100:00100000:1.0:1787393196.941309:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 70 00000100:00100000:1.0:1787393196.941321:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2355:x1874217319626624:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787393196.941618:0:7525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787393196.941622:0:7525:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787393197 -> 1787393196 00002000:00010000:1.0:1787393196.941641:0:7525:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787393196 00002000:00010000:1.0:1787393196.941643:0:7525:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787393197 -> 1787393196 00002000:00010000:1.0:1787393196.941645:0:7525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787393196.941881:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2355:x1874217319626624:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 552us (1462us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787393196.941891:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 70 00010000:00010000:0.0:1787393196.942057:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f22b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.942069:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f22b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.942077:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f22b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.942084:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393196.942090:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f22b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.942098:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f22b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.942118:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9de80398fb00) 00010000:00010000:0.0:1787393196.942121:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393196.942126:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f22b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.942146:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5e00/0x19a927d9c62f22b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393196.944678:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393196.944759:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319626880 00000100:00100000:3.0:1787393196.944771:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319626880 00000100:00100000:3.0:1787393196.944863:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 229 00000100:00100000:3.0:1787393196.944885:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:11599:x1874217319626880:12345-192.168.203.21@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787393196.944977:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.944997:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f2276 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9bb expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.945006:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22bc lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.945064:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f2276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9bb expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.945081:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f2276 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9bb expref: 20 pid: 5821 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393196.945099:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f688380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1874217338481664:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393196.945506:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80763b840 going to sleep for 11 seconds 00000100:00100000:2.0:1787393196.948788:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393196.949566:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f688380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1874217338481664:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393196.949606:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393196.949720:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319627008 00000100:00100000:1.0:1787393196.949730:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319627008 00010000:00010000:1.0:1787393196.949791:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f2276 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9bb expref: 21 pid: 5821 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393196.949883:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 84 00000100:00100000:1.0:1787393196.949894:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:2355:x1874217319627008:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393196.949914:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393196.949923:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f2276 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9bb expref: 21 pid: 5821 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.949937:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f2276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9bb expref: 21 pid: 5821 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.949963:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a600/0x19a927d9c62f2276 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9bb expref: 21 pid: 5821 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.949981:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9de80398fb00) 00010000:00010000:1.0:1787393196.949986:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.949996:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.950164:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.950196:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393196.950261:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:2355:x1874217319627008:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 367us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393196.950271:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 84 00010000:00010000:3.0:1787393196.950345:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.950354:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.950392:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.950400:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.950407:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.950413:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393196.950417:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.950426:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.950436:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9de80398fb00) 00010000:00010000:3.0:1787393196.950439:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787393196.950443:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.950449:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393196.950496:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:11599:x1874217319626880:12345-192.168.203.21@tcp:55:lhsmtool_posix.0 Request processed in 5625us (5834us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787393196.950512:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 229 00000100:00100000:1.0:1787393196.956364:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393196.956527:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319627136 00000100:00100000:0.0:1787393196.956541:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319627136 00000100:00100000:0.0:1787393196.956648:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 71 00000100:00100000:0.0:1787393196.956660:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2356:x1874217319627136:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787393196.956723:0:6625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e9af08ef/0x19a927d9c62f22c3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.956761:0:6625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007d425c22/0x19a927d9c62f22a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d7 expref: 8 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.956772:0:6625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787393196.956776:0:6625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787393196.956781:0:6625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9af08ef/0x19a927d9c62f22c3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.956830:0:6625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007d425c22/0x19a927d9c62f22a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d7 expref: 8 pid: 6622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.956896:0:6625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007d425c22/0x19a927d9c62f22a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d7 expref: 8 pid: 6622 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393196.956914:0:6625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83caa5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6625:1874217338481792:192.168.203.21@tcp:104: 00000100:00100000:0.0:1787393196.957031:0:6625:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351c2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787393196.960014:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.960193:0:6625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83caa5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6625:1874217338481792:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393196.960230:0:6625:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e9af08ef/0x19a927d9c62f22c3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393196.960322:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319627264 00000100:00100000:3.0:1787393196.960333:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319627264 00010000:00010000:3.0:1787393196.960380:0:11945:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007d425c22/0x19a927d9c62f22a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d7 expref: 9 pid: 6622 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393196.960417:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 85 00000100:00100000:3.0:1787393196.960427:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+9:2355:x1874217319627264:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787393196.960444:0:11945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393196.960472:0:11945:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007d425c22/0x19a927d9c62f22a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d7 expref: 9 pid: 6622 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.960485:0:11945:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007d425c22/0x19a927d9c62f22a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d7 expref: 9 pid: 6622 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.960513:0:11945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d425c22/0x19a927d9c62f22a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9d7 expref: 9 pid: 6622 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.960532:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787393196.960536:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787393196.960542:0:11945:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9af08ef/0x19a927d9c62f22c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.960553:0:11945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9af08ef/0x19a927d9c62f22c3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.960610:0:11945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393196.960670:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2355:x1874217319627264:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 242us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393196.960679:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 85 00010000:00010000:1.0:1787393196.961033:0:6625:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e9af08ef/0x19a927d9c62f22c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.961044:0:6625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9af08ef/0x19a927d9c62f22c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.961078:0:6625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e9af08ef/0x19a927d9c62f22c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.961087:0:6625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9af08ef/0x19a927d9c62f22c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.961096:0:6625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9af08ef/0x19a927d9c62f22c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.961116:0:6625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761c200 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:1.0:1787393196.961122:0:6625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9af08ef/0x19a927d9c62f22c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.961131:0:6625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9af08ef/0x19a927d9c62f22c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.961146:0:6625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9af08ef/0x19a927d9c62f22c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393196.961154:0:6625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9af08ef/0x19a927d9c62f22c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393196.961212:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2356:x1874217319627136:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 Request processed in 4555us (4864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393196.961222:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 71 00000100:00100000:2.0:1787393196.964388:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393196.964665:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319627520 00000100:00100000:3.0:1787393196.964679:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319627520 00000100:00100000:3.0:1787393196.964761:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 230 00000100:00100000:3.0:1787393196.964773:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:11599:x1874217319627520:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787393196.964924:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.964947:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.964961:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.965212:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f22d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.965224:0:10433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f2284 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9c2 expref: 20 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.965232:0:10433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f22d1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.965277:0:10433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f2284 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9c2 expref: 20 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.965316:0:10433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f2284 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9c2 expref: 20 pid: 5820 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393196.965334:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f688380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338481920:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393196.965435:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80763b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787393196.968432:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393196.968657:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319627648 00000100:00100000:2.0:1787393196.968669:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319627648 00010000:00010000:2.0:1787393196.968720:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f2284 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9c2 expref: 21 pid: 5820 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393196.968776:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 86 00000100:00100000:2.0:1787393196.968787:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de806f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:2356:x1874217319627648:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393196.968804:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393196.968811:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f2284 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9c2 expref: 21 pid: 5820 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.968826:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f2284 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9c2 expref: 21 pid: 5820 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.968890:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9de80398fb00) 00010000:00010000:2.0:1787393196.968897:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f22d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.968908:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f22d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.968916:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f22d1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393196.968939:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393196.969030:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de806f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:2356:x1874217319627648:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 244us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393196.969038:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 86 00010000:00010000:0.0:1787393196.970665:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385a000/0x19a927d9c62f2284 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9c2 expref: 20 pid: 5820 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393196.970694:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f688380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338481920:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787393196.970729:0:10433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f22d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.970739:0:10433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f22d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.970820:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f22d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787393196.971397:0:10433:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1787393196.971581:0:10433:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787393196.971635:0:10433:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1787393196.971823:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83caa5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10433:1874217338482048:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787393196.972099:0:10433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393196.972212:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de806efef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787393196.972269:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338482048 00000100:00100000:3.0:1787393196.972278:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338482048 00000100:00100000:3.0:1787393196.972441:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787393196.972454:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10433:x1874217338482048:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787393196.972561:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10433:x1874217338482048:12345-0@lo:1000:mdt00_003.0 Request processed in 111us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393196.972570:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787393196.972638:0:10433:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1787393196.972645:0:10433:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:0.0:1787393196.972666:0:10433:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9de82cdb4000, transno 4294967322 00000004:00080000:0.0:1787393196.972686:0:10433:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9de82cdb6300, transno 4294967323 00000100:00100000:0.0:1787393196.972694:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83caa5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10433:1874217338482048:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787393196.973335:0:10433:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787393196.973425:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83caa5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10433:1874217338482176:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787393196.973475:0:10433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393196.975231:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de806efef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787393196.975271:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338482176 00000100:00100000:1.0:1787393196.975282:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338482176 00000100:00100000:1.0:1787393196.975340:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787393196.975351:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83caa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10433:x1874217338482176:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787393196.975739:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83caa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10433:x1874217338482176:12345-0@lo:1000:mdt00_003.0 Request processed in 389us (2262us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787393196.975759:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787393196.975977:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83caa5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10433:1874217338482176:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787393196.976115:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f22d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.976129:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f22d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.976137:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f22d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.976144:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393196.976150:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f22d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.976158:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f22d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.976180:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9de80398fb00) 00010000:00010000:0.0:1787393196.976184:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787393196.976189:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f22d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.976195:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f22d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.976233:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2214 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.976239:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2214 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.976244:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2214 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.976267:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800030c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393196.976270:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2214 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.976276:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2214 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.976286:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:0.0:1787393196.976288:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787393196.976296:0:10433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f221b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9a6 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.976308:0:10433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f221b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9a6 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.976319:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f221b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9a6 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.976380:0:10433:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f221b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9a6 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393196.976399:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835255880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338482304:192.168.203.21@tcp:105: 00000100:00100000:0.0:1787393196.976497:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1787393196.980326:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393196.980416:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319627776 00000100:00100000:2.0:1787393196.980429:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319627776 00000100:00100000:2.0:1787393196.980495:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:2.0:1787393196.980506:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+24:11598:x1874217319627776:12345-192.168.203.21@tcp:49:lfs.0 00000100:00100000:2.0:1787393196.980678:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+24:11598:x1874217319627776:12345-192.168.203.21@tcp:49:lfs.0 Request processed in 173us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393196.980686:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:1.0:1787393196.983203:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393196.983377:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319628032 00000100:00100000:2.0:1787393196.983391:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319628032 00000100:00100000:2.0:1787393196.983461:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 231 00000100:00100000:2.0:1787393196.983474:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+24:11598:x1874217319628032:12345-192.168.203.21@tcp:58:lfs.0 00000040:00080000:2.0:1787393196.984351:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787393196.984473:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+24:11598:x1874217319628032:12345-192.168.203.21@tcp:58:lfs.0 Request processed in 999us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393196.984485:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 231 00000100:00100000:0.0:1787393196.984591:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835255880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10433:1874217338482304:192.168.203.21@tcp:105: 00010000:00010000:0.0:1787393196.984625:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2214 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984651:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f2214 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984693:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984710:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984723:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984735:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984755:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22d8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984763:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984769:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761da00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393196.984773:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984781:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22d8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984793:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:0.0:1787393196.984796:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393196.984799:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22d8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984811:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22d8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984822:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984828:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984834:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984861:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393196.984865:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984880:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984890:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:0.0:1787393196.984893:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787393196.984896:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393196.984901:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f22ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393196.985059:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:11599:x1874217319627520:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 20287us (20684us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1787393196.985068:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 230 00000020:00080000:0.0:1787393196.985079:0:10433:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787393196.985267:0:11566:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787393196.985273:0:11566:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787393196.985322:0:11566:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787393196.985330:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787393196.985455:0:11566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834d41c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11566:1874217338482432:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787393196.985513:0:11566:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393196.992441:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393196.992484:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393196.992559:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319628288 00000100:00100000:3.0:1787393196.992571:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319628288 00000100:00100000:3.0:1787393196.992635:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00100000:3.0:1787393196.992645:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818e27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+24:11599:x1874217319628288:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787393196.993487:0:5823:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787393196.993618:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1787393196.993683:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f22df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.993704:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f22df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.993718:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f22df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.993736:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f22df lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.993743:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f22df lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.993749:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f22df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.993774:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787393196.993938:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818e27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+26:11599:x1874217319628288:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 1290us (1506us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1787393196.993949:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 62 00000020:00080000:3.0:1787393196.993955:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787393196.994024:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393196.994030:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f22df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.994038:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800030800 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393196.994043:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f22df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.994053:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f22df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.994067:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9de8063da400) 00010000:00010000:3.0:1787393196.994070:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787393196.994075:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f22df lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.994090:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030800/0x19a927d9c62f22df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393196.994111:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393196.994113:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393196.994115:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393196.994716:0:11566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834d41c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11566:1874217338482432:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787393196.994900:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319628416 00000100:00100000:2.0:1787393196.994916:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319628416 00000100:00100000:2.0:1787393196.994967:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 232 00000100:00100000:2.0:1787393196.994978:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+25:11600:x1874217319628416:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787393196.995021:0:5822:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787393196.995115:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+25:11600:x1874217319628416:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 138us (2628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393196.995122:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 232 00000100:00100000:1.0:1787393197.002602:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393197.002721:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319628672 00000100:00100000:2.0:1787393197.002735:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319628672 00000100:00100000:2.0:1787393197.002829:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 233 00000100:00100000:2.0:1787393197.002880:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+25:11600:x1874217319628672:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787393197.002913:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393197.002941:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f22e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d9de expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.003093:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f22ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.003110:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f22ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.003124:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f22ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393197.003139:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787393197.003305:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f22e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9de expref: 28 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.003562:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f22ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9de expref: 27 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.003593:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:2.0:1787393197.003596:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787393197.003601:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4800, rc 0) 00000100:00100000:2.0:1787393197.003684:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+27:11600:x1874217319628672:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 844us (1097us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1787393197.003693:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 233 00000100:00080000:1.0:1787393197.006945:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787393197.007514:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393197.007626:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319628928 00000100:00100000:0.0:1787393197.007639:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319628928 00000100:00100000:0.0:1787393197.007711:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 234 00000100:00100000:0.0:1787393197.007724:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+27:11600:x1874217319628928:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787393197.007880:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393197.007903:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393197.007917:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393197.008464:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393197.008474:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393197.008481:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393197.008488:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761da00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393197.008493:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393197.008501:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393197.008516:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:0.0:1787393197.008520:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787393197.008541:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393197.008547:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f22fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393197.008779:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+28:11600:x1874217319628928:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 1055us (1270us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1787393197.008789:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 234 00000100:00100000:1.0:1787393197.014771:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393197.016066:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319629184 00000100:00100000:3.0:1787393197.016084:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319629184 00000100:00100000:3.0:1787393197.016167:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:3.0:1787393197.016180:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+28:11600:x1874217319629184:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787393197.016516:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+29:11600:x1874217319629184:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 337us (1764us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787393197.016525:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 63 00000040:00080000:2.0:1787393197.017687:0:11566:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787393197.017696:0:11566:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787393197.018124:0:11566:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787393197.018133:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787393197.031642:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393197.031773:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319629312 00000100:00100000:2.0:1787393197.031787:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319629312 00000100:00100000:2.0:1787393197.031914:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 235 00000100:00100000:2.0:1787393197.031928:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+29:11602:x1874217319629312:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1787393197.031963:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393197.031991:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2302 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d9e5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.032104:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2309 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.032121:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2309 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.032136:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2309 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.032177:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f2310 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.032185:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f2310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.032192:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f2310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.032549:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f2317 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.032564:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f2206 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d99f expref: 30 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.032574:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f2317 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.032617:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f2206 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d99f expref: 30 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.032635:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f2206 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d99f expref: 30 pid: 5820 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393197.032653:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834d40700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1874217338482560:192.168.203.21@tcp:104: 00000100:00100000:2.0:1787393197.032775:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83501fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393197.035938:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393197.036538:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834d40700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1874217338482560:192.168.203.21@tcp:104: 00010000:00010000:2.0:1787393197.036574:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f2317 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393197.036710:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319629568 00000100:00100000:3.0:1787393197.036721:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319629568 00000100:00100000:0.0:1787393197.037342:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:0.0:1787393197.037355:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82cdb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+31:5565:x1874217319629568:12345-192.168.203.21@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787393197.037670:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+32:5565:x1874217319629568:12345-192.168.203.21@tcp:35:ldlm_bl.0 Request processed in 316us (1744us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787393197.037679:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:1.0:1787393197.040654:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393197.040815:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319629696 00000100:00100000:3.0:1787393197.040830:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319629696 00010000:00010000:3.0:1787393197.040988:0:11945:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f2206 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d99f expref: 32 pid: 5820 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393197.041177:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 87 00000100:00100000:3.0:1787393197.041189:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+32:2356:x1874217319629696:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787393197.041209:0:11945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393197.041218:0:11945:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f2206 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d99f expref: 32 pid: 5820 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393197.041235:0:11945:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f2206 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d99f expref: 32 pid: 5820 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393197.041290:0:11945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f2206 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d99f expref: 32 pid: 5820 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393197.041324:0:11945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:3.0:1787393197.041331:0:11945:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f2317 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393197.041343:0:11945:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f2317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393197.041352:0:11945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f2317 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393197.041392:0:11945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393197.041462:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+31:2356:x1874217319629696:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 274us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393197.041470:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 87 00010000:00010000:1.0:1787393197.041536:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f2317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041547:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f2317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393197.041607:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787393197.041612:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393197.041637:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f2317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041652:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f2317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041664:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2309 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041671:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2309 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041678:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2309 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041684:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393197.041699:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2309 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041707:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2309 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041718:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:1.0:1787393197.041721:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393197.041725:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2309 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041732:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2309 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041757:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f2310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041764:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f2310 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041770:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f2310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041775:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393197.041778:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f2310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041784:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f2310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041793:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9de818bd8600) 00010000:00010000:1.0:1787393197.041794:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393197.041804:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f2310 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041810:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4600/0x19a927d9c62f2310 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041895:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2302 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9e5 expref: 31 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041909:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f2317 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9e5 expref: 30 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393197.041917:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:1.0:1787393197.041919:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393197.041923:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5000, rc 0) 00000100:00100000:1.0:1787393197.041955:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82cdb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+30:11602:x1874217319629312:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 10031us (10329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393197.041963:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 235 00010000:00010000:0.0:1787393197.546179:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787393197.783643:0:12495:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787393197.783655:0:12495:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787393197.783701:0:12495:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787393197.783707:0:12495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787393197.937904:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393197.938016:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319629952 00000100:00100000:2.0:1787393197.938031:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319629952 00000100:00100000:2.0:1787393197.938138:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 236 00000100:00100000:2.0:1787393197.938151:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+30:11626:x1874217319629952:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1787393197.938184:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393197.938209:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f231e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d9ec expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.938343:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2325 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.938359:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2325 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.938376:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2325 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393197.938390:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787393197.938556:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4200/0x19a927d9c62f231e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9ec expref: 33 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.938579:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2325 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9ec expref: 32 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.938606:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:2.0:1787393197.938609:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787393197.938614:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4000, rc 0) 00000100:00100000:2.0:1787393197.938702:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+32:11626:x1874217319629952:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 554us (814us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787393197.938710:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 236 00000100:00100000:0.0:1787393197.954343:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393197.954604:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319630080 00000100:00100000:2.0:1787393197.954618:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319630080 00000100:00100000:2.0:1787393197.954687:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 237 00000100:00100000:2.0:1787393197.954700:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+32:11626:x1874217319630080:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:2.0:1787393197.954794:0:10433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2333 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.954816:0:10433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.954831:0:10433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.954908:0:10433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.954916:0:10433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2333 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.954924:0:10433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2333 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.954932:0:10433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393197.954947:0:10433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2333 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.954955:0:10433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2333 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.954971:0:10433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:2.0:1787393197.954974:0:10433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787393197.954979:0:10433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2333 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393197.954986:0:10433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f2333 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393197.956678:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+32:11626:x1874217319630080:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 1966us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393197.956693:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 237 00000100:00100000:2.0:1787393198.044207:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393198.046624:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319630208 00000100:00100000:1.0:1787393198.046644:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319630208 00000100:00100000:1.0:1787393198.046925:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 72 00000100:00100000:1.0:1787393198.047795:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2355:x1874217319630208:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:1.0:1787393198.047824:0:7525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393198.047911:0:7525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6bc42c7/0x19a927d9c62f233a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d9f3 expref: -99 pid: 7525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787393198.047953:0:7525:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8974ac, atime: 0x6a8974ac, ctime: 0x6a8974ac, blocks: 0xb 00010000:00010000:1.0:1787393198.047980:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=347s v=(0 0) 00010000:00010000:1.0:1787393198.048002:0:7525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393198.048014:0:7525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6bc42c7/0x19a927d9c62f233a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9f3 expref: 8 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393198.048037:0:7525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6bc42c7/0x19a927d9c62f233a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9f3 expref: 8 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393198.048053:0:7525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385ac00, rc 0) 00000100:00100000:1.0:1787393198.048138:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2355:x1874217319630208:12345-192.168.203.21@tcp:101:cat.0 Request processed in 1202us (3945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393198.048148:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 72 00000100:00080000:2.0:1787393198.048941:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787393198.059204:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393198.059630:0:6630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319630336 00000100:00100000:3.0:1787393198.059643:0:6630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319630336 00002000:00100000:3.0:1787393198.059705:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9de834d41500 x1874217319630336/t0(0) o3->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:169/0 lens 488/0 e 0 to 0 dl 1787393209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787393198.059718:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de834d41500 with x1874217319630336 ext(0->4095) 00002000:00010000:3.0:1787393198.059726:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de834d41500 00000100:00100000:3.0:1787393198.059761:0:6630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:3.0:1787393198.059772:0:6630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2353:x1874217319630336:12345-192.168.203.21@tcp:3:cat.0 00000100:00100000:3.0:1787393198.060131:0:6630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2353:x1874217319630336:12345-192.168.203.21@tcp:3:cat.0 Request processed in 359us (940us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787393198.060154:0:6630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00002000:00100000:3.0:1787393198.060161:0:6630:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9de834d41500 x1874217319630336/t0(0) o3->aab0ffcd-9aa3-4dc1-8a02-a1025323dd00@192.168.203.21@tcp:169/0 lens 488/4536 e 0 to 0 dl 1787393209 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787393198.060170:0:6630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9de834d41500 with x1874217319630336 ext(0->4095) 00002000:00010000:3.0:1787393198.060174:0:6630:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9de834d41500 00010000:00010000:3.0:1787393198.570552:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393198.952012:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393198.952052:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319630464 00000100:00100000:0.0:1787393198.952061:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319630464 00000100:00100000:0.0:1787393198.952119:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 293 00000100:00100000:0.0:1787393198.952130:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319630464:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393198.952198:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319630464:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393198.952206:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 293 00000100:00100000:0.0:1787393198.952259:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393198.952378:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393198.952398:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393198.952430:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319630976 00000100:00100000:0.0:1787393198.952434:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319630976 00000100:00100000:0.0:1787393198.952478:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319630592 00000100:00100000:0.0:1787393198.952482:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319630592 00000100:00100000:0.0:1787393198.952506:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 149 00000100:00100000:0.0:1787393198.952514:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319630976:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393198.952557:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2355:x1874217319630976:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 41us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393198.952564:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 149 00000100:00100000:0.0:1787393198.952581:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 150 00000100:00100000:0.0:1787393198.952587:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+32:2355:x1874217319630592:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393198.952610:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+32:2355:x1874217319630592:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 23us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393198.952615:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 150 00000100:00100000:0.0:1787393198.952652:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393198.958716:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319630720 00000100:00100000:3.0:1787393198.958730:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319630720 00000100:00100000:3.0:1787393198.958785:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319630848 00000100:00100000:3.0:1787393198.958789:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319630848 00000100:00100000:3.0:1787393198.958831:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:3.0:1787393198.958863:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2355:x1874217319630720:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393198.958944:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+8:2355:x1874217319630720:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 103us (6683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393198.958951:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:3.0:1787393198.958966:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 74 00000100:00100000:3.0:1787393198.958973:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2355:x1874217319630848:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393198.958995:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2355:x1874217319630848:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 23us (6343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393198.959001:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 74 00000100:00080000:3.0:1787393198.959258:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787393198.959264:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1787393199.015500:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1787393199.015518:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1787393199.015524:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1787393199.466797:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338482688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787393199.466901:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393199.466976:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338482688 00000100:00100000:1.0:1787393199.466983:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338482688 00000100:00100000:1.0:1787393199.467032:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787393199.467040:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c8b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3327:x1874217338482688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787393199.467076:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393199.467119:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c8b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3327:x1874217338482688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393199.467126:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787393199.467334:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338482688:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787393199.468004:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787393199.592064:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393199.977437:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338482944:0@lo:400:kworker.0 00000100:00100000:1.0:1787393199.977456:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8012aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338483200:0@lo:400:kworker.0 00000100:00100000:0.0:1787393199.977532:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338482816:0@lo:400:kworker.0 00000100:00100000:3.0:1787393199.977545:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8012ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338483072:0@lo:400:kworker.0 00000100:00100000:1.0:1787393199.982082:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393199.982428:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338483200 00000100:00100000:1.0:1787393199.982450:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338483200 00000100:00100000:1.0:1787393199.982498:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787393199.982506:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3327:x1874217338483200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393199.983113:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393199.983160:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338483456:0@lo:400:kworker.0 00000100:00100000:2.0:1787393199.983194:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393199.983219:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3327:x1874217338483200:12345-0@lo:400:kworker.0 Request processed in 711us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393199.983229:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787393199.983246:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338483456 00000100:00100000:2.0:1787393199.983252:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338483456 00000100:00100000:1.0:1787393199.983283:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8012aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338483200:0@lo:400:kworker.0 00000100:00100000:2.0:1787393199.983295:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787393199.983305:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338483456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393199.983347:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338483456:12345-0@lo:400:kworker.0 Request processed in 44us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393199.983348:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338482944 00000100:00100000:1.0:1787393199.983354:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338482944 00000100:00100000:1.0:1787393199.983385:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787393199.983392:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338482944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393199.983427:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338482944:12345-0@lo:400:kworker.0 Request processed in 35us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393199.983433:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:1.0:1787393199.983469:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787393199.983947:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787393199.983985:0:3325:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787393199.983992:0:3325:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1787393199.984006:0:3325:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9de83f689f80, transno 4294967310 00000100:00100000:2.0:1787393199.984064:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338483456:0@lo:400:kworker.0 00000100:00100000:2.0:1787393199.984080:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338482944:0@lo:400:kworker.0 00000100:00100000:3.0:1787393199.986016:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393199.986016:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393199.986078:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338483328:0@lo:400:kworker.0 00000100:00100000:3.0:1787393199.986100:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338483072 00000100:00100000:3.0:1787393199.986109:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338483072 00000100:00100000:3.0:1787393199.986157:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787393199.986165:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f68a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338483072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393199.986218:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f68a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338483072:12345-0@lo:400:kworker.0 Request processed in 53us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393199.986225:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1787393199.986247:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393199.986274:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8012ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338483072:0@lo:400:kworker.0 00000100:00100000:3.0:1787393199.986313:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338482816 00000100:00100000:3.0:1787393199.986317:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338482816 00000100:00100000:3.0:1787393199.986343:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787393199.986349:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338482816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393199.986379:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338482816:12345-0@lo:400:kworker.0 Request processed in 30us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393199.986385:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787393199.986897:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393199.986952:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338482816:0@lo:400:kworker.0 00000100:00100000:3.0:1787393199.986959:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338483328 00000100:00100000:3.0:1787393199.986966:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338483328 00000100:00080000:0.0:1787393199.986992:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393199.987012:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787393199.987020:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338483328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393199.987118:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338483328:12345-0@lo:400:kworker.0 Request processed in 98us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393199.987125:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787393199.987183:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338483328:0@lo:400:kworker.0 00000100:00100000:1.0:1787393200.488646:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787393200.488679:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338483584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787393200.488776:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393200.489377:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338483584 00000100:00100000:2.0:1787393200.489389:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338483584 00000100:00100000:2.0:1787393200.489467:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787393200.489478:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338483584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787393200.489527:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393200.489615:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338483584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393200.489622:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787393200.489820:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338483584:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787393200.616046:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787393201.130079:0:11566:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787393201.130088:0:11566:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787393201.130120:0:11566:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787393201.130126:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787393201.640120:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787393202.126939:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:2.0:1787393202.126954:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1787393202.129891:0:12401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:0.0:1787393202.129932:0:12401:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9de803ede000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787393202.129939:0:12401:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9de83cb34a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9de803ede900 00000020:00080000:0.0:1787393202.129943:0:12401:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9de83cb34200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9de834d02c00 00000001:00080000:0.0:1787393202.129970:0:12401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1787393202.130014:0:12401:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1787393202.130134:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787393202.130615:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1787393202.665158:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393203.000308:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393203.000420:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319631104 00000100:00100000:0.0:1787393203.000431:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319631104 00000100:00080000:3.0:1787393203.000577:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393203.003027:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 238 00000100:00100000:0.0:1787393203.003051:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f68a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:11278:x1874217319631104:12345-192.168.203.21@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787393203.003175:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f68a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:11278:x1874217319631104:12345-192.168.203.21@tcp:60:lhsmtool_posix.0 Request processed in 135us (2875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393203.003183:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 238 00000100:00100000:3.0:1787393203.005206:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393203.005323:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319631360 00000100:00100000:2.0:1787393203.005333:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319631360 00000100:00100000:2.0:1787393203.005393:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:2.0:1787393203.005403:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:11278:x1874217319631360:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787393203.005951:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:11278:x1874217319631360:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 546us (751us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787393203.005960:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:1.0:1787393203.274568:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393203.274687:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319631488 00000100:00100000:0.0:1787393203.274697:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319631488 00000100:00100000:0.0:1787393203.274768:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 239 00000100:00100000:0.0:1787393203.274783:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:12077:x1874217319631488:12345-192.168.203.21@tcp:101:lsof.0 00010000:00010000:0.0:1787393203.274803:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393203.274834:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f2341 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0d9fa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393203.274941:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f2348 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393203.274970:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f2348 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393203.274982:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f2348 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393203.275194:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787393203.275198:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787393203.275300:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f2348 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393203.275328:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761de00/0x19a927d9c62f2341 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9fa expref: 7 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393203.275344:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f2348 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9fa expref: 6 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393203.275352:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de80398f500) 00010000:00010000:0.0:1787393203.275355:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787393203.275359:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761da00, rc 0) 00000100:00100000:0.0:1787393203.275419:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:12077:x1874217319631488:12345-192.168.203.21@tcp:101:lsof.0 Request processed in 641us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393203.275426:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 239 00000100:00080000:3.0:1787393203.275666:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787393203.688720:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393204.066592:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393204.066635:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393204.066671:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393204.066705:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393204.066729:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393204.066810:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319632128 00000100:00100000:0.0:1787393204.066819:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319632128 00000100:00100000:0.0:1787393204.066912:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319631744 00000100:00100000:0.0:1787393204.066916:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319631744 00000100:00100000:0.0:1787393204.066937:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 154 00000100:00100000:0.0:1787393204.066960:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:2356:x1874217319632128:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393204.067029:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:2356:x1874217319632128:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 71us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393204.067036:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 154 00000100:00100000:0.0:1787393204.067065:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 155 00000100:00100000:0.0:1787393204.067071:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:2356:x1874217319631744:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393204.067102:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:2356:x1874217319631744:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 32us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393204.067109:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 155 00000100:00100000:2.0:1787393204.067241:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319631616 00000100:00100000:2.0:1787393204.067246:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319631616 00000100:00100000:2.0:1787393204.067287:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 295 00000100:00100000:2.0:1787393204.067295:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80bbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:2356:x1874217319631616:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393204.067324:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80bbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+13:2356:x1874217319631616:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 31us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393204.067329:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 295 00000100:00100000:1.0:1787393204.067449:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319631872 00000100:00100000:1.0:1787393204.067454:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319631872 00000100:00100000:1.0:1787393204.067508:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319632000 00000100:00100000:1.0:1787393204.067511:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319632000 00000100:00100000:1.0:1787393204.067538:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 77 00000100:00100000:1.0:1787393204.067545:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f68b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2356:x1874217319631872:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393204.067575:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f68b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2356:x1874217319631872:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 31us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393204.067581:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 77 00000100:00100000:1.0:1787393204.067593:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 78 00000100:00100000:1.0:1787393204.067599:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2356:x1874217319632000:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393204.067622:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2356:x1874217319632000:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 24us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393204.067629:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 78 00000100:00080000:0.0:1787393204.067831:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787393204.067854:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787393204.584135:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787393204.584158:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338483712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787393204.584226:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393204.584357:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338483712 00000100:00100000:1.0:1787393204.584365:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338483712 00000100:00100000:1.0:1787393204.584436:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787393204.584445:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338483712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787393204.584481:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393204.584530:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338483712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393204.584537:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787393204.584724:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787393204.584754:0:3326:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1787393204.584760:0:3326:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1787393204.584789:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338483712:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787393204.712127:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393205.096233:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338483840:0@lo:400:kworker.0 00000100:00100000:0.0:1787393205.096314:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393205.096427:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338483840 00000100:00100000:1.0:1787393205.096436:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338483840 00000100:00100000:1.0:1787393205.096493:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787393205.096503:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338483840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393205.096929:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338483968:0@lo:400:kworker.0 00000100:00100000:2.0:1787393205.096972:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393205.097023:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338483968 00000100:00100000:2.0:1787393205.097028:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338483968 00000100:00100000:2.0:1787393205.097057:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787393205.097064:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338483968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393205.097104:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338483968:12345-0@lo:400:kworker.0 Request processed in 39us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393205.097111:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787393205.097153:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338483968:0@lo:400:kworker.0 00000100:00100000:1.0:1787393205.101271:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338483840:12345-0@lo:400:kworker.0 Request processed in 4760us (4947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393205.101302:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787393205.101797:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787393205.101825:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338484096:0@lo:400:kworker.0 00000100:00100000:2.0:1787393205.101898:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393205.102119:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338484224:0@lo:400:kworker.0 00000100:00100000:2.0:1787393205.102149:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393205.102186:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338484480:0@lo:400:kworker.0 00000100:00100000:2.0:1787393205.102210:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393205.102226:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787393205.102232:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338484352:0@lo:400:kworker.0 00000100:00100000:2.0:1787393205.102253:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393205.102294:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338484096 00000100:00100000:2.0:1787393205.102301:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338484096 00000100:00100000:2.0:1787393205.102367:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338484352 00000100:00100000:2.0:1787393205.102371:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338484352 00000100:00100000:2.0:1787393205.102392:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787393205.102399:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338484096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393205.102447:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338484096:12345-0@lo:400:kworker.0 Request processed in 47us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393205.102453:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787393205.102467:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787393205.102473:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338484352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393205.102501:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338484352:12345-0@lo:400:kworker.0 Request processed in 29us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393205.102506:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787393205.102558:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338484096:0@lo:400:kworker.0 00000100:00100000:2.0:1787393205.102807:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338484352:0@lo:400:kworker.0 00000100:00080000:2.0:1787393205.102882:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393205.102960:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338484224 00000100:00100000:1.0:1787393205.102965:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338484224 00000100:00100000:1.0:1787393205.102999:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338484480 00000100:00100000:1.0:1787393205.103002:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338484480 00000100:00100000:1.0:1787393205.103029:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787393205.103036:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338484224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393205.103076:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338484224:12345-0@lo:400:kworker.0 Request processed in 41us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393205.103083:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787393205.103096:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787393205.103102:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338484480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393205.103136:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338484480:12345-0@lo:400:kworker.0 Request processed in 35us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393205.103142:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1787393205.103162:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787393205.103184:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338484224:0@lo:400:kworker.0 00000100:00100000:1.0:1787393205.103206:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338484480:0@lo:400:kworker.0 00000100:00100000:0.0:1787393205.103269:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338483840:0@lo:400:kworker.0 00000100:00100000:1.0:1787393205.608684:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787393205.608709:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8012ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338484608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787393205.608791:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393205.609048:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338484608 00000100:00100000:0.0:1787393205.609058:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338484608 00000100:00100000:0.0:1787393205.609105:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787393205.609114:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338484608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787393205.609162:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393205.609213:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338484608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393205.609220:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787393205.609267:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8012ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338484608:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787393205.736049:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393206.760578:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787393206.966502:0:12698:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 06:06:45 (1787393205) 00000020:00080000:0.0:1787393207.177019:0:12402:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787393207.177057:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787393207.177072:0:5853:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:0.0:1787393207.177116:0:12402:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:0.0:1787393207.784220:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393208.808208:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393209.176703:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393209.176764:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393209.176809:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393209.176854:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393209.176875:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319632256 00000100:00100000:3.0:1787393209.176890:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319632256 00000100:00100000:2.0:1787393209.176890:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393209.176922:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319632512 00000100:00100000:2.0:1787393209.176928:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319632512 00000100:00100000:3.0:1787393209.176975:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 297 00000100:00100000:2.0:1787393209.176979:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319632640 00000100:00100000:2.0:1787393209.176985:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319632640 00000100:00100000:3.0:1787393209.176990:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319632256:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393209.177014:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 81 00000100:00100000:2.0:1787393209.177023:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2355:x1874217319632512:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393209.177084:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a168c4-2b38-4392-a418-7572b035c481+13:2355:x1874217319632256:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 97us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393209.177205:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2355:x1874217319632512:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 183us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393209.177214:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 81 00000100:00100000:2.0:1787393209.177235:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 82 00000100:00100000:2.0:1787393209.177241:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2355:x1874217319632640:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393209.177269:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2355:x1874217319632640:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 29us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393209.177276:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 82 00000100:00100000:2.0:1787393209.177295:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319632768 00000100:00100000:2.0:1787393209.177299:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319632768 00000100:00100000:2.0:1787393209.177326:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319632384 00000100:00100000:2.0:1787393209.177329:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319632384 00000100:00100000:2.0:1787393209.177348:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 159 00000100:00100000:2.0:1787393209.177354:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:2355:x1874217319632768:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393209.177564:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 297 00000100:00100000:2.0:1787393209.177568:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:2355:x1874217319632768:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 211us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393209.177578:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 159 00000100:00100000:2.0:1787393209.178242:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 160 00000100:00100000:2.0:1787393209.178254:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:2355:x1874217319632384:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393209.178294:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:2355:x1874217319632384:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 44us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393209.178302:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 160 00000100:00080000:2.0:1787393209.178332:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787393209.178350:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787393209.178354:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787393209.704352:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787393209.704385:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8012aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338484736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787393209.704481:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393209.704618:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338484736 00000100:00100000:1.0:1787393209.704629:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338484736 00000100:00100000:1.0:1787393209.704706:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787393209.704717:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338484736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787393209.704790:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393209.704886:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338484736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393209.704895:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1787393209.704971:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787393209.705016:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8012aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338484736:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787393209.832182:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393210.216457:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8012aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338484864:0@lo:400:kworker.0 00000100:00100000:0.0:1787393210.216535:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393210.216591:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338485376:0@lo:400:kworker.0 00000100:00100000:0.0:1787393210.216617:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393210.216644:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787393210.216649:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8012ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338484992:0@lo:400:kworker.0 00000100:00100000:0.0:1787393210.216667:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393210.216680:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338485504:0@lo:400:kworker.0 00000100:00100000:0.0:1787393210.216698:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393210.216725:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338485376 00000100:00100000:0.0:1787393210.216733:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338485376 00000100:00100000:0.0:1787393210.216797:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338484992 00000100:00100000:0.0:1787393210.216800:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338484992 00000100:00100000:0.0:1787393210.216832:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787393210.216867:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338485376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393210.217004:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338485376:12345-0@lo:400:kworker.0 Request processed in 163us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393210.217011:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787393210.217029:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787393210.217035:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338484992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393210.217061:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338484992:12345-0@lo:400:kworker.0 Request processed in 27us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393210.217067:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787393210.217093:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338485504 00000100:00100000:0.0:1787393210.217096:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338485504 00000100:00100000:0.0:1787393210.217126:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787393210.217189:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338485504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393210.217220:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338485504:12345-0@lo:400:kworker.0 Request processed in 88us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393210.217226:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787393210.217252:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338485248:0@lo:400:kworker.0 00000100:00100000:0.0:1787393210.217272:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393210.217288:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787393210.217293:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338485120:0@lo:400:kworker.0 00000100:00100000:0.0:1787393210.217312:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787393210.217334:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787393210.217339:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393210.217629:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8012ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338484992:0@lo:400:kworker.0 00000100:00100000:0.0:1787393210.217644:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338485504:0@lo:400:kworker.0 00000100:00100000:0.0:1787393210.217654:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338485376:0@lo:400:kworker.0 00000100:00100000:0.0:1787393210.217689:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338485120 00000100:00100000:0.0:1787393210.217692:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338485120 00000100:00100000:1.0:1787393210.217768:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338484864 00000100:00100000:1.0:1787393210.217772:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338484864 00000100:00100000:1.0:1787393210.217811:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787393210.217818:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338484864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393210.217887:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3324:x1874217338484864:12345-0@lo:400:kworker.0 Request processed in 69us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393210.217893:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787393210.217937:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8012aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338484864:0@lo:400:kworker.0 00000100:00100000:0.0:1787393210.218068:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787393210.218075:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338485120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393210.218108:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338485120:12345-0@lo:400:kworker.0 Request processed in 33us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393210.218114:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787393210.218135:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338485120:0@lo:400:kworker.0 00000100:00100000:2.0:1787393210.218575:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338485248 00000100:00100000:2.0:1787393210.218580:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338485248 00000100:00100000:2.0:1787393210.218618:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787393210.218626:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338485248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393210.218671:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338485248:12345-0@lo:400:kworker.0 Request processed in 47us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393210.218677:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787393210.218704:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338485248:0@lo:400:kworker.0 00000100:00080000:3.0:1787393210.220079:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393210.730929:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338485632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787393210.731003:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393210.731142:0:6626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338485632 00000100:00100000:1.0:1787393210.731151:0:6626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338485632 00000100:00100000:1.0:1787393210.731198:0:6626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787393210.731215:0:6626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338485632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787393210.731249:0:6626:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393210.731302:0:6626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338485632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393210.731310:0:6626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787393210.731516:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338485632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787393210.814181:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393210.814323:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319633024 00000100:00100000:3.0:1787393210.814347:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319633024 00000100:00100000:3.0:1787393210.814408:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 66 00000100:00100000:3.0:1787393210.814420:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+19:12299:x1874217319633024:12345-192.168.203.21@tcp:35:umount.0 00000100:00100000:3.0:1787393210.816547:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:12299:x1874217319633024:12345-192.168.203.21@tcp:35:umount.0 Request processed in 2120us (2366us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787393210.816560:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 66 00000100:00100000:3.0:1787393210.822444:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393210.822795:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319633280 00000100:00100000:2.0:1787393210.822806:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319633280 00000100:00100000:2.0:1787393210.822913:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 67 00000100:00100000:2.0:1787393210.822925:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+20:12299:x1874217319633280:12345-192.168.203.21@tcp:35:umount.0 00000100:00100000:2.0:1787393210.823288:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:12299:x1874217319633280:12345-192.168.203.21@tcp:35:umount.0 Request processed in 364us (852us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787393210.823297:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 67 00000100:00100000:2.0:1787393210.827988:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393210.828075:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319633536 00000100:00100000:3.0:1787393210.828086:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319633536 00000100:00100000:3.0:1787393210.828152:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:3.0:1787393210.828163:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de818e25c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+21:12299:x1874217319633536:12345-192.168.203.21@tcp:35:umount.0 00000100:00100000:3.0:1787393210.829181:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de818e25c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+22:12299:x1874217319633536:12345-192.168.203.21@tcp:35:umount.0 Request processed in 1014us (1196us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787393210.829192:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:1.0:1787393210.832627:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393210.833183:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319633792 00000100:00100000:0.0:1787393210.833193:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319633792 00000100:00100000:0.0:1787393210.833357:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:0.0:1787393210.833369:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+22:12299:x1874217319633792:12345-192.168.203.21@tcp:35:umount.0 00000100:00100000:0.0:1787393210.833750:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:12299:x1874217319633792:12345-192.168.203.21@tcp:35:umount.0 Request processed in 381us (1130us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787393210.833759:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:0.0:1787393210.838105:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393210.838152:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393210.838178:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393210.838306:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319634048 00000100:00100000:1.0:1787393210.838316:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319634048 00000100:00100000:1.0:1787393210.838375:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319634304 00000100:00100000:1.0:1787393210.838379:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319634304 00000100:00100000:1.0:1787393210.838393:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319634176 00000100:00100000:1.0:1787393210.838409:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319634176 00000100:00100000:1.0:1787393210.838431:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:1.0:1787393210.838439:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a168c4-2b38-4392-a418-7572b035c481+15:2354:x1874217319634048:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393210.838455:0:11945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393210.838476:0:11945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8040d9400/0x19a927d9c62f13c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d585 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393210.838495:0:11945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393210.838542:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a168c4-2b38-4392-a418-7572b035c481+14:2354:x1874217319634048:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 104us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393210.838549:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:1.0:1787393210.838564:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:1.0:1787393210.838570:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835255c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a168c4-2b38-4392-a418-7572b035c481+13:2354:x1874217319634304:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393210.838576:0:11945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393210.838585:0:11945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80761dc00/0x19a927d9c62f15d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d650 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393210.838593:0:11945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393210.838606:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835255c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a168c4-2b38-4392-a418-7572b035c481+12:2354:x1874217319634304:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 37us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393210.838611:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:1.0:1787393210.838621:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:1.0:1787393210.838626:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a168c4-2b38-4392-a418-7572b035c481+11:2354:x1874217319634176:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393210.838632:0:11945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393210.838638:0:11945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80761c400/0x19a927d9c62f1326 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d54d expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393210.838667:0:11945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393210.838682:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a168c4-2b38-4392-a418-7572b035c481+10:2354:x1874217319634176:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 56us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393210.838688:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:0.0:1787393210.838877:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393210.838903:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319633920 00000100:00100000:0.0:1787393210.838906:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319633920 00000100:00100000:0.0:1787393210.838937:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:0.0:1787393210.838944:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+5:2352:x1874217319633920:12345-192.168.203.21@tcp:9:umount.0 00000020:00000080:0.0:1787393210.838969:0:6625:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1698 00000100:00080000:0.0:1787393210.838979:0:6625:0:(import.c:65:import_set_state_nolock()) ffff9de805487800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787393210.839014:0:6625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787393210.839576:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+2:2352:x1874217319633920:12345-192.168.203.21@tcp:9:umount.0 Request processed in 631us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393210.839584:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 73 00010000:00010000:3.0:1787393210.842078:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393210.847368:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393210.847477:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319634688 00000100:00100000:2.0:1787393210.847492:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319634688 00000100:00100000:2.0:1787393210.847566:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 74 00000100:00100000:2.0:1787393210.847579:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2352:x1874217319634688:12345-192.168.203.21@tcp:9:umount.0 00000020:00000080:2.0:1787393210.847621:0:6622:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1900 00000020:00010000:2.0:1787393210.847630:0:6622:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9de827af4000: total 0 00000100:00080000:2.0:1787393210.847635:0:6622:0:(import.c:65:import_set_state_nolock()) ffff9de827af2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787393210.847700:0:6622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:1.0:1787393210.847729:0:5808:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9de827af4000: total 0 00010000:00010000:1.0:1787393210.847826:0:5808:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9de827af4000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787393210.847935:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6bc42c7/0x19a927d9c62f233a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9f3 expref: 6 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393210.847992:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b6444ad/0x19a927d9c62f1c9c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d825 expref: 5 pid: 7525 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393210.848030:0:5808:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9de827af4000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787393210.848057:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393210.848063:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393210.848065:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393210.848182:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+2:2352:x1874217319634688:12345-192.168.203.21@tcp:9:umount.0 Request processed in 600us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393210.848215:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 74 00010000:00010000:3.0:1787393210.858559:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393210.859746:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393210.859831:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319635712 00000100:00100000:0.0:1787393210.859884:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319635712 00000100:00100000:0.0:1787393210.859976:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 240 00000100:00100000:1.0:1787393210.860088:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+23:2352:x1874217319635712:12345-192.168.203.21@tcp:39:umount.0 00000020:00000080:1.0:1787393210.860128:0:10433:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1334 00000020:00010000:1.0:1787393210.860156:0:10433:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9de834cc1000: total 0 00000100:00080000:1.0:1787393210.860161:0:10433:0:(import.c:65:import_set_state_nolock()) ffff9de83f7db000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787393210.860190:0:10433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1787393210.860209:0:5808:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9de834cc1000: total 0 00010000:00010000:0.0:1787393210.860215:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393210.860274:0:5808:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9de834cc1000, canceled 0 locks, left on hash table 14. 00010000:00010000:0.0:1787393210.860329:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9de8184fcf00) 00010000:00010000:0.0:1787393210.860334:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787393210.860345:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8400/0x19a927d9c62f15fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d65e expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393210.860378:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:0.0:1787393210.860381:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787393210.860385:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761d000/0x19a927d9c62f1c87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d81e expref: 21 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393210.860399:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:0.0:1787393210.860401:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787393210.860414:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4000/0x19a927d9c62f2325 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9ec expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393210.860433:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:0.0:1787393210.860436:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787393210.860441:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f1d1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d848 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393210.860486:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9de8063daa00) 00010000:00010000:0.0:1787393210.860489:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787393210.860493:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f1ff9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d91a expref: 18 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393210.860520:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:0.0:1787393210.860523:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787393210.860529:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4a00/0x19a927d9c62f166e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d67a expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393210.860545:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:0.0:1787393210.860548:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787393210.860551:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b000/0x19a927d9c62f221b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9a6 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393210.860564:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9de818bd8800) 00010000:00010000:0.0:1787393210.860566:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787393210.860571:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f195b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d74c expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393210.860595:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:0.0:1787393210.860598:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787393210.860604:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f1b7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d7d8 expref: 14 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393210.860621:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:0.0:1787393210.860623:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787393210.860635:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f2317 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9e5 expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393210.860654:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9de803da2300) 00010000:00010000:0.0:1787393210.860657:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787393210.860662:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f22ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9de expref: 13 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393210.860689:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de80398f500) 00010000:00010000:0.0:1787393210.860692:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787393210.860697:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385ae00/0x19a927d9c62f1cfe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d841 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393210.860716:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9de8184fc100) 00010000:00010000:0.0:1787393210.860719:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393210.860722:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b200/0x19a927d9c62f161a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d665 expref: 11 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393210.860735:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9de81aa54300) 00010000:00010000:0.0:1787393210.860738:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787393210.860741:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80385b800/0x19a927d9c62f1c5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d810 expref: 10 pid: 10433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393210.860754:0:5808:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9de834cc1000, canceled 14 locks, left on hash table 0. 00010000:00010000:0.0:1787393210.860768:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393210.860769:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393210.860771:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393210.861762:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aab0ffcd-9aa3-4dc1-8a02-a1025323dd00+7:2352:x1874217319635712:12345-192.168.203.21@tcp:39:umount.0 Request processed in 1767us (2019us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787393210.861786:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 240 00000040:00080000:1.0:1787393211.368085:0:11566:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787393211.368095:0:11566:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787393211.368794:0:11566:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1787393211.368803:0:11566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787393211.880089:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787393212.334026:0:12403:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1787393212.334053:0:12403:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00000001:00080000:0.0:1787393212.334073:0:12403:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1787393212.334087:0:12403:0:(genops.c:906:class_export_put()) final put ffff9de834cc1000/aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00000020:00000080:1.0:1787393212.334272:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9de834cc1000/aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 for lustre-MDT0000 00000020:00000080:1.0:1787393212.334335:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de83f7db000 for lustre-MDT0000 00000001:00100000:1.0:1787393212.358393:0:6648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00000020:00000080:1.0:1787393212.358403:0:6648:0:(genops.c:906:class_export_put()) final put ffff9de827af4000/aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00000020:00000080:2.0:1787393212.358563:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de827af4000/aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 for lustre-OST0000 00000020:00000080:2.0:1787393212.358616:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de827af2800 for lustre-OST0000 00000100:00100000:1.0:1787393212.776654:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393212.776700:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393212.776736:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393212.776779:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319635840 00000100:00100000:1.0:1787393212.776798:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319635840 00000100:00100000:1.0:1787393212.776871:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319636096 00000100:00100000:1.0:1787393212.776875:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319636096 00000100:00100000:1.0:1787393212.776890:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319635968 00000100:00100000:1.0:1787393212.776893:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319635968 00000100:00100000:1.0:1787393212.776908:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:1.0:1787393212.776918:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a168c4-2b38-4392-a418-7572b035c481+12:2356:x1874217319635840:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393212.777144:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393212.777167:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8029e2e00/0x19a927d9c62f1406 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d59a expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393212.777185:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393212.777237:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a168c4-2b38-4392-a418-7572b035c481+11:2356:x1874217319635840:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 320us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393212.777246:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:1.0:1787393212.777264:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:1.0:1787393212.777272:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a168c4-2b38-4392-a418-7572b035c481+10:2356:x1874217319636096:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393212.777292:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393212.777302:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80761c600/0x19a927d9c62f15cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d649 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393212.777310:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393212.777328:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a168c4-2b38-4392-a418-7572b035c481+9:2356:x1874217319636096:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 57us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393212.777335:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:1.0:1787393212.777349:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:1.0:1787393212.777355:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de806f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a168c4-2b38-4392-a418-7572b035c481+8:2356:x1874217319635968:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393212.777363:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393212.777372:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8029e3200/0x19a927d9c62f140d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d5c4 expref: 8 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393212.777744:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393212.778475:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de806f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a168c4-2b38-4392-a418-7572b035c481+7:2356:x1874217319635968:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 1116us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393212.778485:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:1.0:1787393212.788530:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393212.788651:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319636352 00000100:00100000:0.0:1787393212.788663:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319636352 00000100:00100000:0.0:1787393212.788749:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 241 00000100:00100000:0.0:1787393212.788759:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c63df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+6:2352:x1874217319636352:12345-192.168.203.21@tcp:39:umount.0 00000020:00000080:0.0:1787393212.788807:0:5820:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f141b 00000020:00010000:0.0:1787393212.788815:0:5820:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9de83fd4d000: total 0 00000100:00080000:0.0:1787393212.788819:0:5820:0:(import.c:65:import_set_state_nolock()) ffff9de83fd48800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787393212.788855:0:5820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1787393212.789272:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c63df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15e12ae6-dd1f-41b4-a172-edb7633b42fc+5:2352:x1874217319636352:12345-192.168.203.21@tcp:39:umount.0 Request processed in 512us (750us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787393212.789281:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 241 00000020:00010000:0.0:1787393212.789311:0:5808:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9de83fd4d000: total 0 00010000:00010000:0.0:1787393212.789347:0:5808:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9de83fd4d000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787393212.789389:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de80398f500) 00010000:00010000:0.0:1787393212.789393:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787393212.789400:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de80761da00/0x19a927d9c62f2348 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d9fa expref: 4 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393212.789422:0:5808:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9de83fd4d000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787393212.789443:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393212.789446:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393212.789448:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787393212.790250:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787393212.814505:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393212.815585:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319636608 00000100:00100000:0.0:1787393212.815597:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319636608 00000100:00100000:0.0:1787393212.815661:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 299 00000100:00100000:0.0:1787393212.815671:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+7:2352:x1874217319636608:12345-192.168.203.21@tcp:251:umount.0 00000020:00000080:0.0:1787393212.815734:0:5815:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1311 00000020:00010000:0.0:1787393212.815742:0:5815:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9de834cc6000: total 0 00000100:00080000:0.0:1787393212.815746:0:5815:0:(import.c:65:import_set_state_nolock()) ffff9de834cc5000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787393212.815868:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a168c4-2b38-4392-a418-7572b035c481+3:2352:x1874217319636608:12345-192.168.203.21@tcp:251:umount.0 Request processed in 167us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393212.815878:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 299 00000020:00010000:3.0:1787393212.816479:0:5809:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9de834cc6000: total 0 00010000:00010000:3.0:1787393212.816484:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393212.816526:0:5809:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9de834cc6000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787393212.816559:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80761ce00/0x19a927d9c62f13c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0d58c expref: 2 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393212.816573:0:5809:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9de834cc6000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787393212.816584:0:5809:0:(genops.c:906:class_export_put()) final put ffff9de834cc6000/88a168c4-2b38-4392-a418-7572b035c481 00010000:00010000:3.0:1787393212.816601:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393212.816603:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393212.816612:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787393212.816872:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de834cc6000/88a168c4-2b38-4392-a418-7572b035c481 for MGS 00000020:00000080:2.0:1787393212.816931:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de834cc5000 for MGS 00010000:00010000:0.0:1787393212.905503:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393213.933689:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787393214.415484:0:7527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00000020:00000080:0.0:1787393214.415497:0:7527:0:(genops.c:906:class_export_put()) final put ffff9de805480000/aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 00000020:00000080:1.0:1787393214.415634:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9de805480000/aab0ffcd-9aa3-4dc1-8a02-a1025323dd00 for lustre-OST0001 00000020:00000080:1.0:1787393214.415686:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de805487800 for lustre-OST0001 00000020:01000004:1.0:1787393214.671588:0:12899:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787393214.700052:0:12899:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787393214.700105:0:12899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f139d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.700121:0:12899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f139d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.700145:0:12899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f139d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.700151:0:12899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f139d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.700188:0:12899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787393214.700194:0:12899:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1787393214.700207:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393214.700216:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f139d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787393214.700223:0:12899:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1787393214.700226:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8029e2800 already unused, calling callback (ffffffffc1cd9c20) 00000100:00100000:1.0:1787393214.700229:0:12899:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 10000000:00010000:0.0:1787393214.700231:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f139d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787393214.700236:0:12899:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1787393214.700244:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a927d9c62f139d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787393214.700252:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a927d9c62f139d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393214.700258:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787393214.700260:0:5808:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787393214.700263:0:5808:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:1.0:1787393214.700265:0:12899:0:(import.c:65:import_set_state_nolock()) ffff9de83c02c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787393214.700294:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f139d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393214.700302:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787393214.700337:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f139d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393214.700345:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8029e2800/0x19a927d9c62f1396 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f139d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393214.700356:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393214.700358:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393214.700360:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393214.700619:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3323:1874217338485760:0@lo:39:umount.0 00000100:00100000:2.0:1787393214.700692:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393214.700772:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338485760 00000100:00100000:2.0:1787393214.700779:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338485760 00000100:00100000:2.0:1787393214.700825:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787393214.700835:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1874217338485760:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787393214.700880:0:5822:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f112e 00000100:00080000:2.0:1787393214.700889:0:5822:0:(import.c:65:import_set_state_nolock()) ffff9de83c028800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787393214.700944:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3323:x1874217338485760:12345-0@lo:39:umount.0 Request processed in 110us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393214.700952:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1787393214.700962:0:5822:0:(genops.c:906:class_export_put()) final put ffff9de83c5e3800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1787393214.701007:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de83c02c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787393214.701015:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3323:1874217338485760:0@lo:39:umount.0 00000020:00000080:0.0:1787393214.701385:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83c5e3800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787393214.701420:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de83c028800 for lustre-MDT0000 00000100:00100000:3.0:1787393214.701660:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787393214.701674:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338485888:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787393214.701686:0:12899:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787393214.701691:0:12899:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787393214.701696:0:12899:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1787393214.701727:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787393214.701781:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393214.701877:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338485888 00000100:00100000:0.0:1787393214.701882:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338485888 00000100:00100000:0.0:1787393214.701923:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787393214.701931:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+19:3326:x1874217338485888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787393214.701942:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393214.701958:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8040d8000/0x19a927d9c62f139d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a927d9c62f1396 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393214.701972:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393214.702005:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:3326:x1874217338485888:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393214.702012:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787393214.702181:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338485888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787393214.702990:0:12899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f13ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.703003:0:12899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f13ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.703010:0:12899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f13ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.703016:0:12899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f13ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.703482:0:12899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787393214.703503:0:12899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f12d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.703511:0:12899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f12d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.703518:0:12899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f12d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.703524:0:12899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f12d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.709618:0:12899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787393214.709632:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787393214.709644:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f13ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.709644:0:12899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f15c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.709659:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9000 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1787393214.709664:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f13ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.709674:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a927d9c62f13ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787393214.709682:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a927d9c62f13ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393214.709688:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787393214.709690:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787393214.709729:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f13ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.709735:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787393214.709771:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f13ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.709796:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8040d9000/0x19a927d9c62f13a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f13ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.709809:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393214.709812:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f12d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.709818:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8e00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1787393214.709821:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f12d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.709828:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a927d9c62f12d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787393214.709834:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a927d9c62f12d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393214.709854:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787393214.709856:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787393214.709858:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787393214.709876:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f12d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.709881:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787393214.709887:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f12d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.709892:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f12cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f12d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.709916:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393214.709918:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393214.709921:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393214.709955:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338486016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787393214.710017:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393214.710075:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787393214.710076:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338486016 00000100:00100000:3.0:1787393214.710084:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338486144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787393214.710085:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338486016 00000100:00100000:3.0:1787393214.710113:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393214.710144:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787393214.710164:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:3324:x1874217338486016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787393214.710178:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787393214.710203:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338486144 00000100:00100000:3.0:1787393214.710208:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338486144 00010000:00010000:2.0:1787393214.710219:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8029e3c00/0x19a927d9c62f13ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a927d9c62f13a4 expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393214.710232:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393214.710240:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787393214.710248:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+18:3324:x1874217338486144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787393214.710257:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393214.710268:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de800030000/0x19a927d9c62f12d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a927d9c62f12cb expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393214.710275:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+18:3324:x1874217338486016:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393214.710284:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1787393214.710286:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393214.710315:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+16:3324:x1874217338486144:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393214.710321:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787393214.710360:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338486144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787393214.710370:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338486016:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787393214.711061:0:12899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f15c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.711071:0:12899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f15c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.711078:0:12899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f15c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.711096:0:12899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787393214.711101:0:12899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2200/0x19a927d9c62f107f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1086 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.711108:0:12899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2200/0x19a927d9c62f107f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f1086 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.711123:0:12899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2200/0x19a927d9c62f107f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f1086 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.711129:0:12899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff9de8029e2200/0x19a927d9c62f107f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f1086 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393214.711141:0:12899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787393214.711145:0:12899:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1787393214.711174:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787393214.711180:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f15c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.711198:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9a00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1787393214.711201:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f15c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.711209:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a927d9c62f15c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787393214.711216:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a927d9c62f15c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393214.711222:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787393214.711224:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787393214.711226:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1787393214.711250:0:12899:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1787393214.711252:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f15c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.711260:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:1.0:1787393214.711281:0:12899:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787393214.711286:0:12899:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:3.0:1787393214.711291:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f15c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787393214.711292:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787393214.711299:0:12899:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00010000:00010000:3.0:1787393214.711301:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8040d9a00/0x19a927d9c62f15bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f15c6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787393214.711306:0:12899:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9de83ca37800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787393214.711315:0:12899:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9de834e0a000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1787393214.711317:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393214.711323:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8029e2200/0x19a927d9c62f107f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f1086 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.711329:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8029e2200 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1787393214.711331:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e2200/0x19a927d9c62f107f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f1086 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.711345:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8029e2200/0x19a927d9c62f107f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a927d9c62f1086 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787393214.711352:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e2200/0x19a927d9c62f107f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a927d9c62f1086 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393214.711357:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787393214.711359:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787393214.711367:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787393214.711380:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8029e2200/0x19a927d9c62f107f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f1086 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.711386:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787393214.711392:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8029e2200/0x19a927d9c62f107f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f1086 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.711397:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8029e2200/0x19a927d9c62f107f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f1086 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393214.711408:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393214.711410:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393214.711412:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787393214.711424:0:12899:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9de83fd4d000 15e12ae6-dd1f-41b4-a172-edb7633b42fc 192.168.203.21@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787393214.711431:0:12899:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9de80bb98000) has exports, disconnecting them 00000100:00100000:2.0:1787393214.711449:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338486272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787393214.711491:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393214.711602:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338486272 00000100:00100000:2.0:1787393214.711608:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338486272 00000100:00100000:2.0:1787393214.711641:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787393214.711649:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+16:3326:x1874217338486272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787393214.711660:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393214.711671:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80761cc00/0x19a927d9c62f15c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a927d9c62f15bf expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393214.711681:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393214.711782:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28e76f01-627f-442b-bc98-cefaf6a7617a+15:3326:x1874217338486272:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393214.711791:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787393214.711826:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338486272:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787393214.715159:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393214.715170:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393214.719894:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338486400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787393214.719973:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1787393214.719973:0:12899:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9de83ca37800), last request at 1787393210 00000020:00000080:1.0:1787393214.719984:0:12899:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1293 00000100:00080000:1.0:1787393214.720000:0:12899:0:(import.c:65:import_set_state_nolock()) ffff9de83ca36800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787393214.720045:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338486400 00000020:00080000:1.0:1787393214.720048:0:12899:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9de83ca37800): rc 0 00000020:00000080:1.0:1787393214.720050:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de83ca37800/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:3.0:1787393214.720052:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338486400 00000020:00080000:1.0:1787393214.720063:0:12899:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9de834e0a000), last request at 1787393210 00000020:00000080:1.0:1787393214.720066:0:12899:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f11c8 00000100:00080000:1.0:1787393214.720072:0:12899:0:(import.c:65:import_set_state_nolock()) ffff9de834e09800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787393214.720079:0:12899:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9de834e0a000): rc 0 00000020:00000080:1.0:1787393214.720080:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de834e0a000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00100000:3.0:1787393214.720097:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000004:00000080:1.0:1787393214.720100:0:12899:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbe58818abae0 00000100:00100000:3.0:1787393214.720105:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+15:3327:x1874217338486400:12345-0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787393214.720116:0:12899:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00010000:00010000:3.0:1787393214.720118:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787393214.720119:0:12899:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1787393214.720130:0:12899:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1787393214.720142:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8040d9600/0x19a927d9c62f1086 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a927d9c62f107f expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787393214.720246:0:12899:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787393214.720257:0:12899:0:(import.c:65:import_set_state_nolock()) ffff9de834cc3800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787393214.720268:0:12899:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787393214.720271:0:12899:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1787393214.720279:0:12899:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787393214.720351:0:12899:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787393214.720360:0:12899:0:(import.c:65:import_set_state_nolock()) ffff9de83f741000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787393214.720391:0:12899:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9de80bb98000) has no exports 00010000:00010000:3.0:1787393214.720397:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393214.720432:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28e76f01-627f-442b-bc98-cefaf6a7617a+14:3327:x1874217338486400:12345-0@lo:103:ldlm_bl.0 Request processed in 327us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393214.720449:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787393214.720487:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:3327:1874217338486400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787393214.720488:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787393214.720502:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c63f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:0:1874217338486528:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787393214.720505:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787393214.720531:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83ca37800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787393214.720568:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9de834e0a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787393214.720588:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de83ca36800 for lustre-MDT0000 00000020:00000080:3.0:1787393214.720592:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de834e09800 for lustre-MDT0000 00000100:00100000:3.0:1787393214.720612:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338486656:0@lo:9:umount.0 00000100:00100000:3.0:1787393214.720640:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393214.720659:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338486784:0@lo:9:umount.0 00000100:00100000:3.0:1787393214.720679:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393214.720704:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338486656 00000100:00100000:3.0:1787393214.720708:0:7525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338486784 00000100:00100000:3.0:1787393214.720711:0:7525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338486784 00000100:00100000:1.0:1787393214.720720:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338486656 00000100:00100000:1.0:1787393214.721787:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787393214.721809:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1874217338486656:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787393214.721836:0:6625:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1215 00000100:00080000:1.0:1787393214.721867:0:6625:0:(import.c:65:import_set_state_nolock()) ffff9de83fac8000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787393214.721893:0:7525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000001:00000004:1.0:1787393214.721902:0:6625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1787393214.721903:0:7525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8351b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1874217338486784:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787393214.721918:0:7525:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f12fc 00000100:00080000:3.0:1787393214.721923:0:7525:0:(import.c:65:import_set_state_nolock()) ffff9de83f7dd800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787393214.721939:0:7525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787393214.722321:0:7525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8351b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3323:x1874217338486784:12345-0@lo:9:umount.0 Request processed in 313us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393214.722397:0:7525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1787393214.722498:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787393214.722502:0:5816:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787393214.722869:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3323:x1874217338486656:12345-0@lo:9:umount.0 Request processed in 1068us (2226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393214.722876:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787393214.722877:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de834cc3800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787393214.722891:0:3323:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787393214.722893:0:3323:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787393214.722897:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338486656:0@lo:9:umount.0 00000100:00080000:3.0:1787393214.722909:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de83f741000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787393214.722916:0:3323:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787393214.722917:0:3323:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787393214.722919:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338486784:0@lo:9:umount.0 00010000:00010000:1.0:1787393214.722921:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393214.722948:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787393214.743351:0:12899:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9de80bb98000) has no exports 00000020:00000080:1.0:1787393214.788696:0:12899:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f10da 00000020:00000080:1.0:1787393214.788711:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de83c5e1800/lustre-QMT0000_UUID 00000020:01000000:1.0:1787393214.788734:0:12899:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787393214.788804:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83c5e1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787393214.788937:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787393214.788949:0:12899:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787393214.788953:0:12899:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9de8103c3380) has no exports 00000020:00000080:0.0:1787393214.789358:0:12899:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f10d3 00000020:00000080:0.0:1787393214.789365:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de83d426000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787393214.789497:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787393214.789505:0:12899:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787393214.789508:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de83d425800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787393214.789510:0:12899:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83d425800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787393214.789517:0:12899:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1787393214.790818:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83d426000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1787393214.952068:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393215.336196:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8089f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338487168:0@lo:400:kworker.0 00000100:00100000:3.0:1787393215.336265:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393215.336322:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787393215.336330:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8089f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338487040:0@lo:400:kworker.0 00000100:00100000:3.0:1787393215.336352:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393215.336384:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338487168 00000100:00100000:3.0:1787393215.336391:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338487168 00000100:00100000:3.0:1787393215.336422:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338487040 00000100:00100000:3.0:1787393215.336424:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338487040 00000100:00100000:3.0:1787393215.336440:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787393215.336447:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8180ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3327:x1874217338487168:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787393215.336455:0:5821:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787393215.336492:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8180ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3327:x1874217338487168:12345-0@lo:400:kworker.0 Request processed in 44us (226us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787393215.336499:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787393215.336525:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787393215.336544:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3327:x1874217338487040:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787393215.336549:0:5821:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787393215.336574:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3327:x1874217338487040:12345-0@lo:400:kworker.0 Request processed in 29us (221us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787393215.336579:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1787393215.336622:0:3327:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787393215.336627:0:3327:0:(import.c:65:import_set_state_nolock()) ffff9de83facc800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787393215.336631:0:3327:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787393215.336995:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8351b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338486912:0@lo:400:kworker.0 00000100:00100000:1.0:1787393215.337035:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393215.337314:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338486912 00000100:00100000:0.0:1787393215.337320:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338486912 00000100:00100000:0.0:1787393215.337358:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787393215.337366:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:3325:x1874217338486912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393215.337416:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28e76f01-627f-442b-bc98-cefaf6a7617a+14:3325:x1874217338486912:12345-0@lo:400:kworker.0 Request processed in 51us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393215.337423:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1787393215.337505:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8351b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338486912:0@lo:400:kworker.0 00000100:00080000:3.0:1787393215.350094:0:3327:0:(import.c:65:import_set_state_nolock()) ffff9de83facc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787393215.350109:0:3327:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 166 00000100:00080000:3.0:1787393215.350119:0:3327:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9de83facc800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:3.0:1787393215.350161:0:3327:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de83f75d880 x1874217338487296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787393215.350328:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3323:1874217338487296:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787393215.350397:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393215.350512:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8089f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338487040:0@lo:400:kworker.0 00000100:00080000:3.0:1787393215.350539:0:3327:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787393215.350544:0:3327:0:(import.c:65:import_set_state_nolock()) ffff9de83fd66800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787393215.350547:0:3327:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787393215.350550:0:3327:0:(import.c:65:import_set_state_nolock()) ffff9de83fd66800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787393215.350553:0:3327:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 183 00000100:00080000:3.0:1787393215.350558:0:3327:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9de83fd66800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:3.0:1787393215.350573:0:3327:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de83f75dc00 x1874217338487424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787393215.351006:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338487296 00000100:00100000:2.0:1787393215.351015:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338487296 00000100:00100000:2.0:1787393215.351056:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787393215.351064:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3323:x1874217338487296:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1787393215.351082:0:5821:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787393215.351281:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3323:1874217338487424:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787393215.351318:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393215.351359:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338487424 00000100:00100000:0.0:1787393215.351363:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338487424 00000100:00100000:0.0:1787393215.351387:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787393215.351392:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3323:x1874217338487424:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1787393215.351400:0:10433:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787393215.351438:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3323:x1874217338487424:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 44us (119us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787393215.351445:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1787393215.351479:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de83fd66800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787393215.351484:0:3323:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787393215.351487:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3323:1874217338487424:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787393215.357760:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8089f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338487168:0@lo:400:kworker.0 00000100:00100000:2.0:1787393215.360922:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3323:x1874217338487296:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 9850us (10517us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787393215.360948:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1787393215.361395:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de83facc800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787393215.361402:0:3323:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787393215.361407:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3323:1874217338487296:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1787393215.976619:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393217.001141:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787393217.446755:0:6648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787393217.446765:0:6648:0:(genops.c:906:class_export_put()) final put ffff9de83fac8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787393217.447703:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83fac8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787393217.447763:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de83fac8000 for lustre-OST0000 00000001:00100000:1.0:1787393217.474818:0:5842:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 15e12ae6-dd1f-41b4-a172-edb7633b42fc 00000001:00080000:1.0:1787393217.474864:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1787393217.474870:0:5842:0:(genops.c:906:class_export_put()) final put ffff9de83fd4d000/15e12ae6-dd1f-41b4-a172-edb7633b42fc 00000020:00000080:0.0:1787393217.480647:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83fd4d000/15e12ae6-dd1f-41b4-a172-edb7633b42fc for lustre-MDT0000 00000020:00000080:0.0:1787393217.480751:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de83fd48800 for lustre-MDT0000 00010000:00010000:3.0:1787393218.024921:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393219.048261:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787393219.487107:0:7527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787393219.487117:0:7527:0:(genops.c:906:class_export_put()) final put ffff9de82e8b1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787393219.487370:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de82e8b1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787393219.487750:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de83f7dd800 for lustre-OST0001 00010000:00010000:3.0:1787393220.073771:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787393220.456311:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787393220.456317:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787393220.456320:0:37:0:(import.c:65:import_set_state_nolock()) ffff9de83facc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787393220.456327:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 364 00000100:00080000:3.0:1787393220.456333:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787393220.456339:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9de83facc800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:3.0:1787393220.456360:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de83f75d180 x1874217338487680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787393220.456383:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787393220.456388:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787393220.456390:0:37:0:(import.c:65:import_set_state_nolock()) ffff9de83fd66800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787393220.456393:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 364 00000100:00080000:3.0:1787393220.456396:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787393220.456399:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9de83fd66800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:3.0:1787393220.456411:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de83f75ce00 x1874217338487808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787393220.456741:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3323:1874217338487680:0@lo:38:kworker.0 00000100:00100000:2.0:1787393220.456809:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393220.456895:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3323:1874217338487808:0@lo:38:kworker.0 00000100:00100000:2.0:1787393220.456916:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393220.457038:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338487552:0@lo:400:kworker.0 00000100:00100000:1.0:1787393220.457073:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393220.457131:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338487552 00000100:00100000:2.0:1787393220.457138:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338487552 00000100:00100000:2.0:1787393220.457190:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787393220.457199:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80fcad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+14:3324:x1874217338487552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393220.457221:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338487680 00000100:00100000:3.0:1787393220.457225:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338487680 00000100:00100000:3.0:1787393220.457245:0:10433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338487808 00000100:00100000:3.0:1787393220.457247:0:10433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338487808 00000100:00100000:2.0:1787393220.457253:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80fcad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28e76f01-627f-442b-bc98-cefaf6a7617a+14:3324:x1874217338487552:12345-0@lo:400:kworker.0 Request processed in 55us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393220.457260:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787393220.457263:0:10433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787393220.457280:0:10433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3323:x1874217338487680:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787393220.457289:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00010000:02000000:3.0:1787393220.457294:0:10433:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787393220.457294:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3323:x1874217338487808:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1787393220.457300:0:5821:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787393220.457329:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3323:x1874217338487808:12345-0@lo:38:kworker.0 Request processed in 33us (411us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787393220.457335:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:2.0:1787393220.457368:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de83fd66800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787393220.457372:0:3323:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787393220.457376:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3323:1874217338487808:0@lo:38:kworker.0 00000100:00100000:1.0:1787393220.458136:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28e76f01-627f-442b-bc98-cefaf6a7617a:3324:1874217338487552:0@lo:400:kworker.0 00000100:00100000:3.0:1787393220.480798:0:10433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3323:x1874217338487680:12345-0@lo:38:kworker.0 Request processed in 23510us (23982us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787393220.480812:0:10433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:2.0:1787393220.484109:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de83facc800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787393220.484122:0:3323:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787393220.484144:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3323:1874217338487680:0@lo:38:kworker.0 00000020:01000000:0.0:1787393220.840385:0:12899:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9de83d596ea0 - data ffff9de83ff3b948/ffff9de82cc84c00 00000020:01000000:0.0:1787393220.840504:0:12899:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9de805555cc0 - data ffff9de840fb75e8/ffff9de81871a000 00000001:00000004:0.0:1787393220.850084:0:12899:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1787393220.960929:0:12899:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787393220.960936:0:12899:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1787393220.960960:0:12899:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787393220.960962:0:12899:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787393220.961562:0:6769:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787393220.961568:0:6769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1787393220.961579:0:6769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787393220.962582:0:12899:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787393220.962587:0:12899:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1787393220.962606:0:12899:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787393220.962608:0:12899:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787393220.963047:0:7896:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787393220.963051:0:7896:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1787393220.963059:0:7896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787393221.048160:0:12899:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f10a2 00000020:00000080:3.0:1787393221.048171:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de83c02e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787393221.049459:0:12899:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f10b7 00000020:00000080:3.0:1787393221.049468:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de818db6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787393221.049779:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83c02e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787393221.049991:0:12899:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787393221.049998:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787393221.050006:0:12899:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787393221.050011:0:12899:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9de80bb9cd40) has no exports 00000004:01000000:3.0:1787393221.050166:0:12899:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787393221.050175:0:12899:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f12f5 00000020:00000080:3.0:1787393221.050179:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de82e8b2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787393221.050183:0:12899:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787393221.050186:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787393221.050193:0:12899:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787393221.050195:0:12899:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9de83f8019c0) has no exports 00000020:00000080:3.0:1787393221.050201:0:12899:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f12ee 00000020:00000080:3.0:1787393221.050204:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de83f740800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787393221.050533:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de818db6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1787393221.050540:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de82e8b2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787393221.050545:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83f740800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787393221.050631:0:12899:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787393221.050645:0:12899:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787393221.050650:0:12899:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1787393221.050655:0:12899:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787393221.050657:0:12899:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787393221.050733:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787393221.050739:0:12899:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787393221.050744:0:12899:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f120e 00000020:00000080:3.0:1787393221.050749:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de83fac9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787393221.050799:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de83f741000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787393221.050865:0:36:0:(genops.c:906:class_export_put()) final put ffff9de83ca33800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787393221.050868:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83ca33800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787393221.050873:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787393221.051165:0:12899:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787393221.051170:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787393221.051174:0:12899:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787393221.051176:0:12899:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9de81808cd40) has no exports 00000020:00000080:3.0:1787393221.051181:0:12899:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1207 00000020:00000080:3.0:1787393221.051184:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de83c028000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787393221.051235:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83fac9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1787393221.051632:0:12899:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787393221.051635:0:12899:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787393221.051638:0:12899:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1787393221.051642:0:12899:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787393221.051644:0:12899:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787393221.052138:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83c028000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787393221.052298:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787393221.052307:0:12899:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787393221.052334:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787393221.052337:0:12899:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787393221.052341:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de83c029800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787393221.052343:0:12899:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83c029800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787393221.052348:0:12899:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787393221.052495:0:12899:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f10be 00000020:00000080:3.0:1787393221.052501:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de818db5000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787393221.052557:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de834cc3800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787393221.052563:0:36:0:(genops.c:906:class_export_put()) final put ffff9de834e1c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787393221.052565:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de834e1c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787393221.052569:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787393221.058743:0:12899:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787393221.058758:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787393221.058767:0:12899:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787393221.058771:0:12899:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9de80bb999c0) has no exports 00000020:00000080:3.0:1787393221.058814:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787393221.058820:0:12899:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787393221.061682:0:12899:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f10c5 00000020:00000080:3.0:1787393221.061697:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de818db1800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787393221.061963:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de818db5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787393221.061983:0:36:0:(genops.c:906:class_export_put()) final put ffff9de818db5800/lustre-MDD0000_UUID 00000020:00000080:0.0:1787393221.061985:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de818db5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787393221.061991:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1787393221.062095:0:12899:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9de804ca6000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787393221.062099:0:12899:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9de804ca6000 3 00000020:01000004:3.0:1787393221.062102:0:12899:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9de804ca6000 from lustre-MDT0000 00000020:00000080:3.0:1787393221.062135:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787393221.062146:0:12899:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787393221.062149:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de83c02c800/lustre-MDT0000_UUID 00000020:00000080:3.0:1787393221.062151:0:12899:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83c02c800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787393221.062159:0:12899:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787393221.062222:0:12899:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1787393221.062227:0:12899:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787393221.062230:0:12899:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787393221.062235:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787393221.062239:0:12899:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787393221.062245:0:12899:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9de804ca2000 28e76f01-627f-442b-bc98-cefaf6a7617a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787393221.062251:0:12899:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9de8103c0000) has exports, disconnecting them 00000020:00080000:3.0:1787393221.062254:0:12899:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9de804ca2000), last request at 1787393000 00000020:00000080:3.0:1787393221.062268:0:12899:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f105c 00000020:00010000:3.0:1787393221.062272:0:12899:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9de804ca2000: total 2 00000100:00080000:3.0:1787393221.062276:0:12899:0:(import.c:65:import_set_state_nolock()) ffff9de804ca3800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787393221.062608:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de818db1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1787393221.062669:0:12899:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9de804ca2000): rc 0 00000020:00080000:3.0:1787393221.062675:0:12899:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9de8103c0000) has no exports 00000100:00100000:3.0:1787393221.062741:0:5814:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9de8203a1000:5814] 1 exiting: rc = 0 00000100:00100000:0.0:1787393221.062885:0:5815:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9de818185800:5815] 2 exiting: rc = 0 00000020:00010000:1.0:1787393221.063098:0:5808:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9de804ca2000: total 0 00010000:00010000:1.0:1787393221.063124:0:5808:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9de804ca2000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787393221.063157:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8040d8a00/0x19a927d9c62f117b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a927d9c62f1174 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393221.063178:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de801530000/0x19a927d9c62f1373 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a927d9c62f136c expref: 8 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393221.063204:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80761d200/0x19a927d9c62f1365 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a927d9c62f135e expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393221.063216:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80761d800/0x19a927d9c62f1381 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a927d9c62f137a expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393221.063226:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8029e3000/0x19a927d9c62f138f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a927d9c62f1388 expref: 5 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393221.063237:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8186b5800/0x19a927d9c62f15b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a927d9c62f15b1 expref: 4 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393221.063246:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de801531000/0x19a927d9c62f15aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a927d9c62f15a3 expref: 3 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393221.063258:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8029e3600/0x19a927d9c62f13b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19a927d9c62f13b2 expref: 2 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393221.063267:0:5808:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9de804ca2000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787393221.063279:0:5808:0:(genops.c:906:class_export_put()) final put ffff9de804ca2000/28e76f01-627f-442b-bc98-cefaf6a7617a 00010000:00010000:1.0:1787393221.063323:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393221.063325:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393221.063327:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787393221.063349:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de804ca2000/28e76f01-627f-442b-bc98-cefaf6a7617a for MGS 00000020:00000080:0.0:1787393221.063428:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de804ca3800 for MGS 00000100:00100000:2.0:1787393221.064118:0:5813:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9de84195fe00:5813] 0 exiting: rc = 1 00000100:00100000:3.0:1787393221.065207:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065215:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065222:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065227:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065233:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065239:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065256:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065266:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065272:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065277:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065283:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065289:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065295:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065301:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065306:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065311:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065316:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065322:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065328:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065333:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065340:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065345:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065351:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065356:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065362:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065367:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065372:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065377:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065382:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065387:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065392:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065398:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065403:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065408:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065413:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065418:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065422:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065427:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065432:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065437:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065442:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065454:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065624:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065633:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065639:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065645:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065650:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065655:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065660:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065665:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065670:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065675:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065681:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065685:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065691:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065696:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065702:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065717:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065723:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065728:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065733:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065739:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065744:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.065749:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1787393221.066276:0:12899:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787393221.066279:0:12899:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1787393221.067597:0:12899:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9de80775f780 - data ffff9de81ec37360/ffff9de8181ff000 00000020:01000000:3.0:1787393221.067727:0:12899:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9de80fc87000 - data ffff9de81ec38a20/ffff9de8181aa800 00000020:00000080:3.0:1787393221.068225:0:12899:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1047 00000020:00000080:3.0:1787393221.068233:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de807653000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787393221.068250:0:12899:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9de804ca6000 from MGS, refs=2 00000020:01000004:3.0:1787393221.068253:0:12899:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9de804ca6000 2 00000020:01000004:3.0:1787393221.068256:0:12899:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9de804ca6000 from MGS 00000020:00000080:3.0:1787393221.068274:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787393221.068280:0:12899:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787393221.068291:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de804ca5000/MGS 00000020:00000080:3.0:1787393221.068294:0:12899:0:(genops.c:865:class_export_destroy()) destroying export ffff9de804ca5000/MGS for MGS 00000020:01000000:3.0:1787393221.068301:0:12899:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787393221.068353:0:12899:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787393221.068358:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787393221.068363:0:12899:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787393221.068370:0:12899:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9de83c02d800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787393221.068376:0:12899:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9de8180eb380) has exports, disconnecting them 00000020:00080000:3.0:1787393221.068380:0:12899:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9de83c02d800), last request at 1787393002 00000020:00000080:3.0:1787393221.068383:0:12899:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1112 00000020:00080000:3.0:1787393221.068392:0:12899:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9de83c02d800): rc 0 00000020:00000080:3.0:1787393221.068395:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de83c02d800/lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787393221.069046:0:12899:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787393221.069051:0:12899:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787393221.069055:0:12899:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787393221.069060:0:12899:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787393221.069163:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787393221.069169:0:12899:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787393221.069180:0:12899:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9de804ca6000 1 00000020:00000080:1.0:1787393221.069185:0:12899:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1039 00000020:00000080:1.0:1787393221.069190:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de804ca2800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787393221.069194:0:12899:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787393221.069197:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787393221.069199:0:12899:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787393221.069201:0:12899:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9de80bb9b380) has no exports 00000020:00000080:0.0:1787393221.069288:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de807653000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787393221.069297:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83c02d800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787393221.069302:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de83c02c000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787393221.069307:0:36:0:(genops.c:906:class_export_put()) final put ffff9de82c8cf000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787393221.069309:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de82c8cf000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787393221.069312:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787393221.069352:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de804ca2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1787393221.105778:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787393221.110493:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787393221.110507:0:12899:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787393221.110513:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de803804000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787393221.110517:0:12899:0:(genops.c:865:class_export_destroy()) destroying export ffff9de803804000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787393221.110524:0:12899:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787393221.110636:0:12899:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9de804ca5800 00000020:01000000:1.0:1787393221.110658:0:12899:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787393221.110662:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787393221.110666:0:12899:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787393221.110670:0:12899:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9de8103c19c0) has no exports 00000100:00100000:1.0:1787393221.110749:0:5820:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9de8180e2000:5820] 0 exiting: rc = 1 00000100:00100000:0.0:1787393221.112872:0:5822:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9de808348a00:5822] 2 exiting: rc = 0 00000100:00100000:2.0:1787393221.113362:0:5821:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9de8180e3400:5821] 1 exiting: rc = 0 00000100:00100000:3.0:1787393221.113748:0:10433:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9de83514b800:10433] 3 exiting: rc = 0 00000100:00100000:1.0:1787393221.114061:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114069:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114076:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114082:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114088:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114095:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114101:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114106:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114116:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114122:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114128:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114133:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114139:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114146:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114164:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114170:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114176:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114181:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114186:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114192:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114199:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114204:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114210:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114216:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114222:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114227:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114233:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114239:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114244:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114249:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114255:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114260:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114266:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114272:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114279:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114285:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114290:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114296:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114301:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114306:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114312:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114318:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114323:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114329:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114334:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114340:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114346:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114352:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114358:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114377:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114383:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114389:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114395:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114401:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114407:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114413:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114419:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114425:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114431:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114437:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114442:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114448:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114454:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.114459:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393221.118430:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9de8181b9a00:5823] 0 exiting: rc = 1 00000100:00100000:0.0:1787393221.118632:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9de818e8ba00:5824] 1 exiting: rc = 0 00000100:00100000:1.0:1787393221.118738:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118746:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118752:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118758:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118764:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118770:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118780:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118786:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118792:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118799:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118805:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118814:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118822:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118929:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118935:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118940:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118945:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118952:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118957:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118963:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118980:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118986:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118992:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.118997:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119002:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119008:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119014:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119019:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119024:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119029:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119034:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119040:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119045:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119051:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119056:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119061:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119066:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119071:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119076:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119081:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119086:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119091:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119096:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119102:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119107:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119112:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119118:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119124:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119129:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119134:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119139:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119144:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119149:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119154:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119158:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119170:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119175:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119179:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119184:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119189:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119194:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119200:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119205:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.119210:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.119645:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9de808349400:5826] 1 exiting: rc = 0 00000100:00100000:2.0:1787393221.120027:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9de84195ec00:5825] 0 exiting: rc = 1 00000100:00100000:0.0:1787393221.120300:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120307:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120314:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120320:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120325:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120331:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120337:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120342:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120349:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120355:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120361:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120367:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120373:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120380:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120406:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120412:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120418:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120424:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120430:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120436:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120441:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120447:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120453:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120459:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120464:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120470:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120491:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120498:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120504:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120510:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120517:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120522:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120527:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120533:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120538:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120542:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120547:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120552:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120569:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120575:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120580:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120585:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120590:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120595:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120600:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120605:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120611:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120616:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120623:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120635:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120652:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120660:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120665:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120669:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120675:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120680:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120684:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120689:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120697:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120716:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120722:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120727:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120734:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.120739:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.127526:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9de808349800:5828] 1 exiting: rc = 0 00000100:00100000:2.0:1787393221.127812:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9de808349a00:5827] 0 exiting: rc = 1 00000100:00100000:0.0:1787393221.128298:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128306:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128311:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128316:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128321:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128327:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128332:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128338:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128344:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128349:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128355:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128360:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128365:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128370:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128375:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128380:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128385:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128390:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128396:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128414:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128418:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128423:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128428:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128432:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128437:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128442:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128446:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128450:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128455:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128459:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128465:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128470:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128475:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128480:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128485:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128489:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128494:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128499:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128504:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128509:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128515:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128521:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128527:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128532:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128537:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128542:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128548:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128553:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128558:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128563:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128568:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128574:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128579:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128584:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128595:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128600:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128605:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128610:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128615:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128620:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128625:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128629:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128634:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.128639:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.129267:0:5830:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9de808349c00:5830] 1 exiting: rc = 0 00000100:00100000:3.0:1787393221.129664:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9de808348c00:5829] 0 exiting: rc = 1 00000100:00100000:0.0:1787393221.129811:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129817:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129822:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129865:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129870:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129875:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129879:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129884:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129889:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129895:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129900:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129905:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129909:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129914:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129919:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129923:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129928:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129933:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129939:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129944:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129949:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129953:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129958:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129963:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129968:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129981:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129986:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129991:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129995:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.129999:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130005:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130010:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130014:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130019:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130024:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130029:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130034:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130039:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130043:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130048:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130053:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130058:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130063:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130068:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130073:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130079:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130083:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130088:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130092:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130097:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130102:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130107:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130111:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130117:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130122:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130127:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130132:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130136:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130142:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130147:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130159:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130164:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130169:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130175:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.130481:0:5832:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9de818e8a200:5832] 1 exiting: rc = 0 00000100:00100000:1.0:1787393221.130597:0:5831:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9de818e8bc00:5831] 0 exiting: rc = 1 00000100:00100000:0.0:1787393221.131019:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131024:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131029:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131034:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131038:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131043:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131047:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131051:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131056:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131061:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131066:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131071:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131077:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131082:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131086:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131090:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131095:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131100:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131105:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131110:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131115:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131120:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131126:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131131:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131136:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131141:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131146:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131151:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131156:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131161:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131175:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131181:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131186:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131191:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131196:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131201:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131206:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131210:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131215:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131220:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131224:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131229:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131234:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131240:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131244:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131249:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131254:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131260:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131265:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131269:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131275:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131279:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131284:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131289:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131294:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131299:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131303:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131308:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131312:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131317:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131321:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131326:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131331:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393221.131337:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393221.132286:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9de810328e00:5834] 1 exiting: rc = 0 00000100:00100000:1.0:1787393221.133035:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9de83b468400:5833] 0 exiting: rc = 1 00000100:00100000:3.0:1787393221.133375:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9de810328800:5835] 2 exiting: rc = 0 00000100:00100000:1.0:1787393221.133526:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133539:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133546:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133552:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133557:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133563:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133568:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133574:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133580:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133587:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133592:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133598:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133604:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133609:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133616:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133621:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133628:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133633:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133639:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133645:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133651:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133656:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133662:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133678:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133683:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133688:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133718:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133725:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133730:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133735:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133742:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133748:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133754:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133759:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133765:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133770:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133776:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133781:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133786:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133793:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133800:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133806:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133812:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133817:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133854:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133862:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133868:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133873:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133878:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133883:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133906:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133912:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133917:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133923:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133928:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133934:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133940:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133945:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133958:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133963:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133969:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133974:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133979:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393221.133984:0:12899:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787393221.137356:0:12899:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787393221.137368:0:12899:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787393221.137373:0:12899:0:(genops.c:906:class_export_put()) final put ffff9de818c21800/MDS_uuid 00000020:00000080:1.0:1787393221.137377:0:12899:0:(genops.c:865:class_export_destroy()) destroying export ffff9de818c21800/MDS_uuid for MDS 00000020:01000000:1.0:1787393221.137383:0:12899:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787393221.137502:0:12899:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787393222.126731:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393223.144786:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787393224.052143:0:13051:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787393224.060325:0:13051:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787393224.061904:0:13051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1381 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393224.061919:0:13051:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f1381 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393224.061928:0:13051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f1381 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393224.061936:0:13051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f1381 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393224.061956:0:13051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787393224.061961:0:13051:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1787393224.061986:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787393224.061992:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f1381 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393224.062000:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8200 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1787393224.062003:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f1381 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393224.062023:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a927d9c62f1381 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787393224.062030:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a927d9c62f1381 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393224.062036:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787393224.062038:0:5808:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787393224.062041:0:5808:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787393224.062075:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f1381 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393224.062082:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:3.0:1787393224.062094:0:13051:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787393224.062100:0:13051:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787393224.062106:0:13051:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1787393224.062106:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f1381 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787393224.062114:0:13051:0:(import.c:65:import_set_state_nolock()) ffff9de83facc800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1787393224.062116:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8040d8200/0x19a927d9c62f137a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f1381 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787393224.062121:0:13051:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787393224.062126:0:13051:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787393224.062129:0:13051:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787393224.062131:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393224.062135:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393224.062137:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393224.062153:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338487936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787393224.062217:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393224.062307:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338487936 00000100:00100000:2.0:1787393224.062313:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338487936 00000100:00100000:2.0:1787393224.062346:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787393224.062354:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3325:x1874217338487936:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787393224.062361:0:5807:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787393224 with bad export cookie 1849052938298658908 00010000:00010000:3.0:1787393224.063343:0:13051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f138f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393224.063355:0:13051:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f138f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393224.063362:0:13051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f138f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393224.063377:0:13051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f138f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393224.063400:0:13051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787393224.063407:0:13051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f15b8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393224.063413:0:13051:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f15b8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393224.063418:0:13051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f15b8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393224.063423:0:13051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f15b8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393224.063437:0:13051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787393224.063441:0:13051:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:1.0:1787393224.063472:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787393224.063480:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f138f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393224.063489:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530a00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1787393224.063492:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f138f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393224.063500:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a927d9c62f138f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393224.063508:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a927d9c62f138f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393224.063514:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787393224.063517:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787393224.063519:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787393224.063547:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f138f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393224.063564:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:3.0:1787393224.063566:0:13051:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787393224.063572:0:13051:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787393224.063577:0:13051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787393224.063584:0:13051:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787393224.063588:0:13051:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9de83f800000) has no exports 00010000:00010000:1.0:1787393224.063589:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f138f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393224.063600:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de801530a00/0x19a927d9c62f1388 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f138f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393224.063608:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338488064:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787393224.063613:0:13051:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9de83f800000) has no exports 00000100:00100000:0.0:1787393224.063663:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393224.063721:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338488064 00000100:00100000:0.0:1787393224.063727:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338488064 00000100:00100000:0.0:1787393224.063757:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787393224.063763:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de806f5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3326:x1874217338488064:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787393224.063769:0:11945:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787393224 with bad export cookie 1849052938298658908 00000100:00100000:0.0:1787393224.063810:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de806f5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3326:x1874217338488064:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (146us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787393224.063817:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1787393224.063890:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787393224.063896:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f15b8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393224.063902:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9e00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1787393224.063905:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f15b8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393224.063911:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a927d9c62f15b8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393224.063918:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a927d9c62f15b8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393224.063924:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787393224.063926:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787393224.063929:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:0.0:1787393224.063937:0:3326:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.121@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787393224.063942:0:3326:0:(import.c:65:import_set_state_nolock()) ffff9de8090e0800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787393224.063946:0:3326:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:3.0:1787393224.066325:0:13051:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9de80775fd80 - data ffff9de840d5b360/ffff9de82cff8c00 00000020:01000000:3.0:1787393224.066742:0:13051:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9de806f30780 - data ffff9de81ec330d8/ffff9de83f54f000 00000100:00080000:0.0:1787393224.084708:0:3326:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.121@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787393224.084715:0:3326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787393224.084724:0:3326:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9de83c5a5c00 x1874217338487936/t0(0) o103->MGC192.168.203.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787393240 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393224.084754:0:3326:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9de835329f80 x1874217338488064/t0(0) o103->MGC192.168.203.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787393240 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787393224.084772:0:3326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787393224.084775:0:3326:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787393224.084776:0:3326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:1.0:1787393224.084943:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f15b8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787393224.084948:0:3326:0:(import.c:65:import_set_state_nolock()) ffff9de8090e0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787393224.084957:0:3326:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 0@lo last attempt 150 00010000:00010000:1.0:1787393224.084959:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1787393224.084968:0:3326:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9de8090e0800 using connection 192.168.203.121@tcp/0@lo 00010000:00010000:1.0:1787393224.084979:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f15b8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393224.085011:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8040d9e00/0x19a927d9c62f15b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x19a927d9c62f15b8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393224.085013:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28e76f01-627f-442b-bc98-cefaf6a7617a:3325:1874217338487936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787393224.085038:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393224.085041:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393224.085043:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393224.085058:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28e76f01-627f-442b-bc98-cefaf6a7617a:0:1874217338488192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787393224.085207:0:3326:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de835329c00 x1874217338488320/t0(0) o250->MGC192.168.203.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787393224.085306:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28e76f01-627f-442b-bc98-cefaf6a7617a:3326:1874217338488064:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787393224.085421:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393224.085464:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:28e76f01-627f-442b-bc98-cefaf6a7617a:3323:1874217338488320:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1787393224.085514:0:3323:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874217338488320 offset 0 length 520: 4 00000400:00000100:3.0:1787393224.096326:0:5807:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1874217338487936 offset 224 length 224: 4 00000100:00100000:3.0:1787393224.096354:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3325:x1874217338487936:12345-0@lo:103:ldlm_bl.0 Request processed in 33998us (34135us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787393224.096367:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00100000:10000000:3.0:1787393224.108534:0:13051:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787393224.134126:0:13051:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1197 00000020:00000080:3.0:1787393224.134136:0:13051:0:(genops.c:906:class_export_put()) final put ffff9de83f78e800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787393224.134159:0:13051:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9de83d423000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787393224.134162:0:13051:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9de83d423000 2 00000020:01000004:3.0:1787393224.134165:0:13051:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9de83d423000 from lustre-OST0000 00000020:00000080:3.0:1787393224.134187:0:13051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787393224.134197:0:13051:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787393224.134197:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83f78e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787393224.134201:0:13051:0:(genops.c:906:class_export_put()) final put ffff9de83f788000/lustre-OST0000_UUID 00000020:00000080:3.0:1787393224.134204:0:13051:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83f788000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787393224.134213:0:13051:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787393224.134255:0:13051:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787393224.134259:0:13051:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787393224.134263:0:13051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787393224.134268:0:13051:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787393224.134274:0:13051:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9de83face800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787393224.134280:0:13051:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9de8180ecd40) has exports, disconnecting them 00000020:00080000:3.0:1787393224.134284:0:13051:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9de83face800), last request at 1787393017 00000020:00000080:3.0:1787393224.134288:0:13051:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f11c1 00000020:00080000:3.0:1787393224.134297:0:13051:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9de83face800): rc 0 00000020:00000080:3.0:1787393224.134301:0:13051:0:(genops.c:906:class_export_put()) final put ffff9de83face800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787393224.134514:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83face800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787393224.137897:0:13051:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787393224.137906:0:13051:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787393224.137911:0:13051:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787393224.137918:0:13051:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787393224.138050:0:13051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787393224.138057:0:13051:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787393224.138064:0:13051:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9de83d423000 1 00000020:00000080:2.0:1787393224.138070:0:13051:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1151 00000020:00000080:2.0:1787393224.138078:0:13051:0:(genops.c:906:class_export_put()) final put ffff9de82d0c3800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787393224.138084:0:13051:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787393224.138088:0:13051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787393224.138092:0:13051:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787393224.138095:0:13051:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9de8103c4d40) has no exports 00000020:00000080:1.0:1787393224.138178:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de83facc800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787393224.138186:0:36:0:(genops.c:906:class_export_put()) final put ffff9de83faca000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787393224.138189:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83faca000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787393224.138195:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787393224.138247:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de82d0c3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787393224.155512:0:13051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787393224.155551:0:13051:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787393224.155557:0:13051:0:(genops.c:906:class_export_put()) final put ffff9de8187c1800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787393224.155561:0:13051:0:(genops.c:865:class_export_destroy()) destroying export ffff9de8187c1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787393224.155569:0:13051:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787393224.155780:0:13051:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9de83b442000 00000020:02000400:2.0:1787393224.156285:0:13051:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787393224.175452:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393225.194062:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787393225.576017:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 28e76f01-627f-442b-bc98-cefaf6a7617a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787393225.576026:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 28e76f01-627f-442b-bc98-cefaf6a7617a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787393225.576029:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787393225.576032:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787393225.576036:0:36:0:(import.c:65:import_set_state_nolock()) ffff9de83fd66800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787393225.576045:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 369 00000100:00080000:2.0:1787393225.576050:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787393225.576057:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9de83fd66800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:2.0:1787393225.576166:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de83c5a4700 x1874217338488448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787393225.576475:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3323:1874217338488448:0@lo:38:kworker.0 00000400:00000100:3.0:1787393225.576526:0:3323:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874217338488448 offset 0 length 520: 4 00010000:00010000:2.0:1787393226.223023:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787393226.881134:0:13202:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787393226.891007:0:13202:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787393226.891101:0:13202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f135e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1365 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393226.891115:0:13202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f135e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f1365 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393226.891122:0:13202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f135e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f1365 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393226.891130:0:13202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f135e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f1365 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393226.891187:0:13202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787393226.891192:0:13202:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787393226.891211:0:13202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787393226.891221:0:13202:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9de83c5a4700 x1874217338488448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787393245 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393226.891245:0:13202:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787393226.891251:0:13202:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787393226.891257:0:13202:0:(import.c:65:import_set_state_nolock()) ffff9de83fd66800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787393226.891261:0:13202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787393226.891265:0:13202:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9de83c5a4700 x1874217338488448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787393245 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393226.891271:0:13202:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787393226.891273:0:13202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:1.0:1787393226.891324:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3323:1874217338488448:0@lo:38:kworker.0 00010000:00010000:3.0:1787393226.891627:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393226.891633:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f135e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f1365 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393226.891641:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8600 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1787393226.891645:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f135e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f1365 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393226.891654:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f135e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a927d9c62f1365 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787393226.891661:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f135e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a927d9c62f1365 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393226.891677:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787393226.891680:0:5808:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787393226.891682:0:5808:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787393226.891695:0:5808:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9de8090e0800 00010000:00010000:3.0:1787393226.891698:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f135e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a927d9c62f1365 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393226.891705:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8040d8600/0x19a927d9c62f135e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a927d9c62f1365 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393226.891715:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393226.891716:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393226.891718:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393226.892341:0:13202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2600/0x19a927d9c62f136c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f1373 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393226.892348:0:13202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2600/0x19a927d9c62f136c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f1373 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393226.892361:0:13202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8029e2600/0x19a927d9c62f136c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f1373 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393226.892366:0:13202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff9de8029e2600/0x19a927d9c62f136c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f1373 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393226.892378:0:13202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787393226.892384:0:13202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f15a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f15aa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393226.892390:0:13202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f15a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f15aa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393226.892396:0:13202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f15a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f15aa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393226.892401:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393226.892402:0:13202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f15a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19a927d9c62f15aa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393226.892407:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8029e2600/0x19a927d9c62f136c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f1373 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393226.892414:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8029e2600 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1787393226.892417:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e2600/0x19a927d9c62f136c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f1373 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393226.892420:0:13202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787393226.892424:0:13202:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787393226.892442:0:13202:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787393226.892447:0:13202:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787393226.892451:0:13202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787393226.892457:0:13202:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787393226.892461:0:13202:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9de8180e8000) has no exports 00000020:00080000:0.0:1787393226.892482:0:13202:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9de8180e8000) has no exports 00010000:00010000:2.0:1787393226.892492:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8029e2600/0x19a927d9c62f136c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a927d9c62f1373 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787393226.892500:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e2600/0x19a927d9c62f136c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a927d9c62f1373 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393226.892505:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787393226.892508:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1787393226.892510:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1787393226.892517:0:5809:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9de8090e0800 00010000:00010000:2.0:1787393226.892520:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8029e2600/0x19a927d9c62f136c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a927d9c62f1373 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393226.892527:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8029e2600/0x19a927d9c62f136c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a927d9c62f1373 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393226.892538:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787393226.892541:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f15a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f15aa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393226.892556:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761c000 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1787393226.892559:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f15a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19a927d9c62f15aa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393226.892566:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f15a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a927d9c62f15aa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787393226.892573:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f15a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a927d9c62f15aa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393226.892578:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787393226.892580:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787393226.892581:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787393226.892586:0:5809:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9de8090e0800 00010000:00010000:2.0:1787393226.892589:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f15a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a927d9c62f15aa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393226.892595:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f15a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a927d9c62f15aa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393226.892607:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393226.892609:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393226.892610:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393226.892650:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787393226.894643:0:13202:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9de83d596ae0 - data ffff9de802205a20/ffff9de83fd5e800 00000020:01000000:0.0:1787393226.896154:0:13202:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9de83c72b900 - data ffff9de81eec85e8/ffff9de83fd5ec00 00100000:10000000:0.0:1787393226.906403:0:13202:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787393226.932718:0:13202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1262 00000020:00000080:1.0:1787393226.932729:0:13202:0:(genops.c:906:class_export_put()) final put ffff9de83facd000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787393226.932742:0:13202:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9de834a79800 from lustre-OST0001, refs=2 00000020:00000080:2.0:1787393226.932790:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83facd000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000004:1.0:1787393226.933160:0:13202:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9de834a79800 2 00000020:01000004:1.0:1787393226.933163:0:13202:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9de834a79800 from lustre-OST0001 00000020:00000080:1.0:1787393226.933190:0:13202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787393226.933210:0:13202:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787393226.933213:0:13202:0:(genops.c:906:class_export_put()) final put ffff9de834e0d800/lustre-OST0001_UUID 00000020:00000080:1.0:1787393226.933215:0:13202:0:(genops.c:865:class_export_destroy()) destroying export ffff9de834e0d800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787393226.933221:0:13202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787393226.933377:0:13202:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 28e76f01-627f-442b-bc98-cefaf6a7617a->MGS 00010000:00010000:1.0:1787393226.933392:0:13202:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8029e3e00/0x19a927d9c62f1174 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a927d9c62f117b expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393226.933403:0:13202:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8029e3e00/0x19a927d9c62f1174 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a927d9c62f117b expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393226.933409:0:13202:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787393226.933412:0:13202:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787393226.933415:0:13202:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787393226.933435:0:13202:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9de8090e0800 00010000:00010000:1.0:1787393226.933439:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8029e3e00/0x19a927d9c62f1174 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a927d9c62f117b expref: -99 pid: 6620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393226.933454:0:13202:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de801531400/0x19a927d9c62f13b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x19a927d9c62f13b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393226.933461:0:13202:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de801531400/0x19a927d9c62f13b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x19a927d9c62f13b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393226.933467:0:13202:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787393226.933469:0:13202:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787393226.933471:0:13202:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787393226.933480:0:13202:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9de8090e0800 00010000:00010000:1.0:1787393226.933482:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de801531400/0x19a927d9c62f13b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x19a927d9c62f13b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787393226.933498:0:13202:0:(import.c:65:import_set_state_nolock()) ffff9de8090e0800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787393226.933509:0:13202:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787393226.933511:0:13202:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787393226.933513:0:13202:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787393226.933517:0:13202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787393226.933529:0:13202:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9de835329c00 x1874217338488320/t0(0) o250->MGC192.168.203.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787393234 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787393226.933592:0:13202:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787393226.933596:0:13202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:3.0:1787393226.933640:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:28e76f01-627f-442b-bc98-cefaf6a7617a:3323:1874217338488320:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:1.0:1787393226.933697:0:13202:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787393226.933705:0:13202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1055 00000020:00000080:1.0:1787393226.933709:0:13202:0:(genops.c:906:class_export_put()) final put ffff9de807652000/28e76f01-627f-442b-bc98-cefaf6a7617a 00000020:01000000:1.0:1787393226.933722:0:13202:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.121@tcp (flags='') 00000020:00000080:1.0:1787393226.933726:0:13202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787393226.933731:0:13202:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.121@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787393226.933734:0:13202:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9de8180e99c0) has no exports 00000020:00000080:2.0:1787393226.933767:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de807652000/28e76f01-627f-442b-bc98-cefaf6a7617a for MGC192.168.203.121@tcp 10000000:01000000:2.0:1787393226.933913:0:5818:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787393226.934107:0:13202:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.121@tcp: client import never connected 00000100:00080000:1.0:1787393226.934111:0:13202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787393226.934113:0:13202:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787393226.934115:0:13202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787393226.934117:0:13202:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787393226.934151:0:13202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787393226.934156:0:13202:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.121@tcp (uuid 28e76f01-627f-442b-bc98-cefaf6a7617a) 00000020:01000000:1.0:1787393226.934161:0:13202:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787393226.934163:0:13202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787393226.934167:0:13202:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787393226.934172:0:13202:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9de83fd63800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787393226.934177:0:13202:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9de834ed19c0) has exports, disconnecting them 00000020:00080000:1.0:1787393226.934181:0:13202:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9de83fd63800), last request at 1787393034 00000020:00000080:1.0:1787393226.934184:0:13202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f128c 00000020:00080000:1.0:1787393226.934196:0:13202:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9de83fd63800): rc 0 00000020:00000080:1.0:1787393226.934200:0:13202:0:(genops.c:906:class_export_put()) final put ffff9de83fd63800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787393226.935072:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83fd63800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787393226.935204:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de8090e0800 for MGC192.168.203.121@tcp 00000020:00000080:2.0:1787393226.935223:0:36:0:(genops.c:906:class_export_put()) final put ffff9de803800800/28e76f01-627f-442b-bc98-cefaf6a7617a 00000020:00000080:2.0:1787393226.935225:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de803800800/28e76f01-627f-442b-bc98-cefaf6a7617a for MGC192.168.203.121@tcp 00000020:01000000:2.0:1787393226.935229:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.121@tcp (28e76f01-627f-442b-bc98-cefaf6a7617a) 00010000:01000000:2.0:1787393226.937913:0:13202:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787393226.937921:0:13202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787393226.937925:0:13202:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787393226.937933:0:13202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787393226.938022:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1787393226.938227:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:3.0:1787393226.938308:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9de83fd66800 for lustre-MDT0000-lwp-OST0001 00000100:00100000:3.0:1787393226.938488:0:5804:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9de8187cf800:5804] 1 exiting: rc = 0 00000100:00100000:0.0:1787393226.939380:0:5803:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9de826cc4c00:5803] 0 exiting: rc = 1 00000100:00100000:2.0:1787393226.939424:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.940439:0:11945:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9de82d0ed600:11945] 3 exiting: rc = 0 00000100:00100000:3.0:1787393226.940522:0:5806:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9de8187cea00:5806] 1 exiting: rc = 0 00000100:00100000:3.0:1787393226.940576:0:5807:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9de8187cf200:5807] 2 exiting: rc = 0 00000100:00100000:0.0:1787393226.940712:0:5805:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9de826cc4200:5805] 0 exiting: rc = 1 00000100:00100000:2.0:1787393226.940758:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940765:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940774:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940784:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940800:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940806:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940812:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940818:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940825:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940830:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940864:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940872:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940879:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940893:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940900:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940906:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940912:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940917:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940922:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940928:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940933:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940938:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940944:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940949:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940965:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940971:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940986:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940992:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.940997:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941002:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941008:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941013:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941018:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941022:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941027:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941031:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941036:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941042:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941047:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941052:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941057:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941062:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941066:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941070:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941075:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941080:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941084:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941088:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941094:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941098:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941103:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941108:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941113:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941117:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941122:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941127:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941132:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941136:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941141:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941154:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941160:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941164:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941169:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.941174:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787393226.941758:0:13202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787393226.941767:0:13202:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787393226.941773:0:13202:0:(genops.c:906:class_export_put()) final put ffff9de8187c3000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787393226.941777:0:13202:0:(genops.c:865:class_export_destroy()) destroying export ffff9de8187c3000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787393226.941782:0:13202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1787393226.941818:0:13202:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9de834a79800 1 00000020:00000080:2.0:1787393226.941824:0:13202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x19a927d9c62f1231 00000020:00000080:2.0:1787393226.941829:0:13202:0:(genops.c:906:class_export_put()) final put ffff9de83ca32000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787393226.941854:0:13202:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787393226.941859:0:13202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787393226.941863:0:13202:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787393226.941867:0:13202:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9de834ed0000) has no exports 00000020:00000080:3.0:1787393226.942312:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9de83ca32000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787393226.955324:0:13202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787393226.955340:0:13202:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787393226.955346:0:13202:0:(genops.c:906:class_export_put()) final put ffff9de834a7c000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787393226.955351:0:13202:0:(genops.c:865:class_export_destroy()) destroying export ffff9de834a7c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787393226.955358:0:13202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787393226.955539:0:13202:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9de834a7d800 00000020:01000000:3.0:1787393226.955560:0:13202:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787393226.955564:0:13202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787393226.955568:0:13202:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787393226.955572:0:13202:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9de834ed4d40) has no exports 00000020:00000080:3.0:1787393226.955607:0:13202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787393226.955614:0:13202:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787393226.955616:0:13202:0:(genops.c:906:class_export_put()) final put ffff9de82d0c0000/OSS_uuid 00000020:00000080:3.0:1787393226.955619:0:13202:0:(genops.c:865:class_export_destroy()) destroying export ffff9de82d0c0000/OSS_uuid for OSS 00000020:01000000:3.0:1787393226.955622:0:13202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1787393226.955650:0:5816:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787393226.955861:0:6624:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9de83d584600:6624] 1 exiting: rc = 0 00000100:00100000:3.0:1787393226.958209:0:7525:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9de83fd47800:7525] 3 exiting: rc = 0 00000100:00100000:3.0:1787393226.959076:0:6622:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9de834b6a600:6622] 0 exiting: rc = 1 00000100:00100000:3.0:1787393226.959136:0:6625:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9de83c316a00:6625] 2 exiting: rc = 0 00000100:00100000:3.0:1787393226.959218:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959234:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959243:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959249:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959254:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959259:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959276:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959281:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959285:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959290:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959295:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959299:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959305:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959315:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959323:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959332:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959338:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959343:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959351:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959357:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959361:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959367:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959372:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959376:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959381:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959390:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959396:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959400:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959405:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959410:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959415:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959420:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959425:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959429:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959434:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959439:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959444:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959449:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959454:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959460:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959467:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959481:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959486:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959492:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959520:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959527:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959537:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959541:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959546:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959552:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959557:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.959562:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.960250:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.960260:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.960265:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.960271:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.960276:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.960281:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.960285:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.960290:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.960295:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.960300:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.960305:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.960326:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.961551:0:6627:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9de83c316e00:6627] 1 exiting: rc = 0 00000100:00100000:2.0:1787393226.962088:0:6626:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9de83c31da00:6626] 0 exiting: rc = 1 00000100:00100000:3.0:1787393226.962274:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962281:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962285:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962290:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962296:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962301:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962305:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962309:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962322:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962329:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962334:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962344:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962368:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962373:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962378:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962383:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962388:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962395:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962400:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962405:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962409:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962414:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962419:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962424:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962429:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962434:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962439:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962445:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962450:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962455:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962461:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962467:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962473:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962477:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962483:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962488:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962493:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962497:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962510:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962516:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962525:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962529:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962535:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962545:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962551:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962557:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962565:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962578:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962584:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962590:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962601:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962606:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962611:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962617:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962622:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962627:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962632:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962637:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962641:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962646:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962652:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962658:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962690:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.962701:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.964852:0:6630:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9de83c31dc00:6630] 2 exiting: rc = 0 00000100:00100000:2.0:1787393226.964877:0:6628:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9de834e17600:6628] 0 exiting: rc = 1 00000100:00100000:0.0:1787393226.964992:0:6629:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9de834e16c00:6629] 1 exiting: rc = 0 00000100:00100000:3.0:1787393226.965290:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965297:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965313:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965321:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965326:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965331:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965336:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965342:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965348:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965353:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965358:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965363:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965368:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965373:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965378:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965383:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965388:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965405:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965410:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965416:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965421:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965519:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965525:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965531:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965536:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965542:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965561:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965568:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965573:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965579:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965584:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965590:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965595:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965600:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965617:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965622:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965627:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965633:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965638:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965644:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965650:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965656:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965661:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965676:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965682:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965688:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965693:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965699:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965708:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965714:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965735:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965746:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965762:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965771:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965781:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.965787:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.966640:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.966647:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.966653:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.966659:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.966674:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.966679:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.966685:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787393226.966690:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787393226.975523:0:6631:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9de834e16a00:6631] 0 exiting: rc = 1 00000100:00100000:3.0:1787393226.975781:0:6632:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9de834e79200:6632] 1 exiting: rc = 0 00000100:00100000:2.0:1787393226.976038:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976047:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976052:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976057:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976061:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976067:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976072:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976079:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976084:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976088:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976095:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976099:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976104:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976121:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976127:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976132:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976719:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976731:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976736:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976741:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976745:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976750:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976755:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976761:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976766:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976771:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976777:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976782:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.976786:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977124:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977131:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977137:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977142:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977147:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977152:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977157:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977162:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977167:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977172:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977178:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977183:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977187:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977192:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977197:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977202:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977208:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977214:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977220:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977235:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977240:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977245:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977249:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977255:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977260:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977265:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977271:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977277:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977282:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977287:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977292:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977297:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977303:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977309:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.977314:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787393226.984074:0:6634:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9de834e79000:6634] 1 exiting: rc = 0 00000100:00100000:1.0:1787393226.984101:0:6633:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9de834e16000:6633] 0 exiting: rc = 1 00000100:00100000:2.0:1787393226.984184:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984198:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984228:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984239:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984245:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984251:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984257:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984265:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984272:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984293:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984300:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984323:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984330:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984337:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984343:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984350:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984355:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984361:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984368:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984383:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984392:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984398:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984404:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984442:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984450:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984456:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984463:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984469:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984475:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984481:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984487:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984494:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984501:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984508:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984515:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984536:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984543:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984549:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984555:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984562:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984568:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984578:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984585:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984592:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984599:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984605:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984611:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984633:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984641:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984648:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984657:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984672:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984680:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984686:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984700:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984707:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984713:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984719:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984726:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984732:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984747:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984753:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984766:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787393226.984773:0:13202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787393226.996142:0:13202:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787393242.543146:0:13819:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787393249.811058:0:14231:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787393249.811066:0:14231:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787393249.811193:0:14231:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9de83f587000 00000020:01000004:1.0:1787393249.811215:0:14231:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1787393249.811225:0:14231:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787393249.811245:0:14231:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9de818088000) 00000020:00000080:1.0:1787393249.811262:0:14231:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787393249.845466:0:14231:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787393249.857382:0:14231:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787393249.859833:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1787393249.860063:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1787393249.860211:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1787393249.860311:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1787393249.860412:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1787393249.860640:0:14231:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787393249.860716:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1787393249.861598:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1787393249.863471:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 578: rc = 0 00100000:10000000:2.0:1787393249.863587:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 578: rc = 0 00100000:10000000:2.0:1787393249.865538:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1787393249.868110:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 775: rc = 0 00100000:10000000:2.0:1787393249.868375:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1787393249.868613:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1787393249.870025:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 775: rc = 0 00100000:10000000:2.0:1787393249.870272:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 775: rc = 0 00100000:10000000:2.0:1787393249.870492:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 775: rc = 0 00100000:10000000:2.0:1787393249.870723:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1787393249.872811:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 775: rc = 0 00100000:10000000:2.0:1787393249.874345:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1787393249.874605:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1787393249.876113:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 775: rc = 0 00100000:10000000:2.0:1787393249.876522:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 288: rc = 0 00100000:10000000:2.0:1787393249.877141:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 288: rc = 0 00100000:10000000:2.0:1787393249.877368:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 288: rc = 0 00100000:10000000:2.0:1787393249.877597:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 288: rc = 0 00100000:10000000:2.0:1787393249.878571:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 288: rc = 0 00100000:10000000:2.0:1787393249.878912:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 288: rc = 0 00100000:10000000:2.0:1787393249.879329:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 288: rc = 0 00100000:10000000:2.0:1787393249.879563:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 288: rc = 0 00100000:10000000:2.0:1787393249.880127:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 288: rc = 0 00100000:10000000:2.0:1787393249.880358:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 288: rc = 0 00100000:10000000:2.0:1787393249.880635:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 288: rc = 0 00100000:10000000:2.0:1787393249.881286:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 288: rc = 0 00100000:10000000:2.0:1787393249.881518:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 288: rc = 0 00100000:10000000:2.0:1787393249.883645:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 288: rc = 0 00100000:10000000:3.0:1787393249.885345:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 288: rc = 0 00100000:10000000:3.0:1787393249.885624:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 288: rc = 0 00100000:10000000:3.0:1787393249.885932:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 288: rc = 0 00100000:10000000:3.0:1787393249.886246:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 288: rc = 0 00100000:10000000:3.0:1787393249.886500:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 288: rc = 0 00100000:10000000:3.0:1787393249.886782:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 288: rc = 0 00100000:10000000:3.0:1787393249.887089:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 288: rc = 0 00100000:10000000:3.0:1787393249.887389:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 288: rc = 0 00100000:10000000:3.0:1787393249.887687:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 288: rc = 0 00100000:10000000:3.0:1787393249.887991:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 288: rc = 0 00100000:10000000:3.0:1787393249.888260:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 288: rc = 0 00100000:10000000:3.0:1787393249.893640:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 288: rc = 0 00100000:10000000:3.0:1787393249.895631:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 288: rc = 0 00100000:10000000:3.0:1787393249.896664:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 288: rc = 0 00100000:10000000:3.0:1787393249.899275:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 288: rc = 0 00100000:10000000:3.0:1787393249.899639:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 288: rc = 0 00100000:10000000:3.0:1787393249.900265:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 288: rc = 0 00100000:10000000:3.0:1787393249.900524:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 288: rc = 0 00100000:10000000:3.0:1787393249.906311:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 789: rc = 0 00100000:10000000:3.0:1787393249.907622:0:14231:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787393249.908163:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 579: rc = 0 00100000:10000000:3.0:1787393249.908382:0:14231:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787393249.908467:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 579: rc = 0 00100000:10000000:3.0:1787393249.908694:0:14231:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787393249.909422:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 579: rc = 0 00100000:10000000:3.0:1787393249.911657:0:14231:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787393249.912309:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 772: rc = 0 00100000:10000000:3.0:1787393249.912562:0:14231:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787393249.912636:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 772: rc = 0 00100000:10000000:3.0:1787393249.913174:0:14231:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787393249.913248:0:14231:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 772: rc = 0 00000020:00000080:3.0:1787393249.923559:0:14231:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787393249.923574:0:14231:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787393249.924638:0:14231:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a927d9c62f2356 00000020:01000004:2.0:1787393249.924653:0:14231:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787393249.924668:0:14231:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787393249.924675:0:14231:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9de83f587000 from MGS 00000020:01000004:2.0:1787393249.924679:0:14231:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787393249.924693:0:14231:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9de83f803380) 00000020:00000080:2.0:1787393249.924706:0:14231:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787393249.924770:0:14231:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9de83f587000 from MGS, refs=2 00080000:01000000:2.0:1787393249.924776:0:14231:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787393249.924780:0:14231:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a927d9c62f2364 00000100:00100000:2.0:1787393249.925109:0:14231:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787393249.925223:0:14231:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787393249.925229:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787393249.927623:0:14231:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787393249.927634:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787393249.943160:0:14231:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787393249.943326:0:14231:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787393249.943332:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787393249.948041:0:14231:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787393249.948056:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787393249.949383:0:14231:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787393249.949392:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787393249.953270:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393249.953276:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393249.953279:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393249.956193:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393249.956214:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393249.956218:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393249.960985:0:14231:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787393249.966789:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787393249.985344:0:14231:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787393249.985365:0:14231:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787393249.985367:0:14231:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787393249.987151:0:14240:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787393249.987329:0:14231:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787393249.987449:0:14231:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787393249.988046:0:14231:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787393249.988434:0:14231:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787393249.988606:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787393249.988612:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787393249.992430:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787393249.992447:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787393249.993140:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787393249.993148:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787393249.994063:0:14231:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787393249.994083:0:14231:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.121@tcp' 00000020:01000004:0.0:1787393249.994085:0:14231:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787393249.994111:0:14231:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.121@tcp (typ=mgc) 00000020:00000080:0.0:1787393249.994122:0:14231:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.121@tcp (ffff9de8180eb380) 00000020:00000080:0.0:1787393249.994136:0:14231:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787393249.994198:0:14231:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9de804ca4000@MGC192.168.203.121@tcp: add connection 192.168.203.121@tcp at head 00010000:00010000:0.0:1787393249.994327:0:14231:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.121@tcp-0 is initialized 00000040:01000000:0.0:1787393249.994332:0:14231:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787393249.994616:0:14245:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787393249.995568:0:14246:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787393249.995645:0:14231:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.121@tcp (uuid 529eca5c-3a2f-4c24-8f17-b3e707cfe67a) 00000020:00000080:0.0:1787393249.995663:0:14231:0:(genops.c:1406:class_connect()) connect: client 529eca5c-3a2f-4c24-8f17-b3e707cfe67a, cookie 0x19a927d9c62f2372 00000100:00080000:0.0:1787393249.995673:0:14231:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787393249.995678:0:14231:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9de804ca4000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:0.0:1787393249.995709:0:14231:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de835257b80 x1874217338488576/t0(0) o250->MGC192.168.203.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787393249.995780:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3323:1874217338488576:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787393249.995858:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393249.996086:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338488576 00000100:00100000:0.0:1787393249.996094:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338488576 00000100:00100000:0.0:1787393249.996123:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787393249.996131:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f76c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3323:x1874217338488576:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787393249.996153:0:14242:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 529eca5c-3a2f-4c24-8f17-b3e707cfe67a@0@lo t0 exp 0000000000000000 cur 399 last 0 00000020:00000080:0.0:1787393249.996181:0:14242:0:(genops.c:1406:class_connect()) connect: client 529eca5c-3a2f-4c24-8f17-b3e707cfe67a, cookie 0x19a927d9c62f2379 00000100:00080000:0.0:1787393249.996326:0:14242:0:(import.c:65:import_set_state_nolock()) ffff9de804ca1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787393249.996487:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f76c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+5:3323:x1874217338488576:12345-0@lo:250:mount.lustre.0 Request processed in 354us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393249.996495:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787393249.996532:0:14231:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 529eca5c-3a2f-4c24-8f17-b3e707cfe67a->MGS 00000020:01000004:0.0:1787393249.996551:0:14231:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787393249.996556:0:14231:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787393249.996567:0:14231:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9de8180e99c0) 00000020:00000080:0.0:1787393249.996579:0:14231:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787393250.010222:0:3323:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.121@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787393250.010236:0:3323:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.121@tcp: connect to target with instance 0 00000100:00080000:1.0:1787393250.010245:0:3323:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.121@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787393250.010250:0:3323:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787393250.010254:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de804ca4000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787393250.010258:0:3323:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787393250.011694:0:3323:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787393250.011711:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3323:1874217338488576:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787393250.020044:0:14231:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787393250.020365:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787393250.020370:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787393250.021272:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787393250.021281:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787393250.021561:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787393250.021567:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787393250.023482:0:14231:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787393250.023657:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787393250.023663:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787393250.025615:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787393250.025626:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787393250.080164:0:14231:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787393250.080341:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787393250.080348:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787393250.082778:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787393250.082798:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787393250.083439:0:14231:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787393250.083643:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787393250.083649:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787393250.085139:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787393250.085152:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787393250.099796:0:14231:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787393250.100019:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787393250.100025:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787393250.100834:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787393250.100867:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787393250.102149:0:14231:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787393250.102328:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787393250.102335:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787393250.115324:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787393250.115345:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787393250.159969:0:14231:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787393250.160159:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787393250.160166:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787393250.175573:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787393250.175595:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787393250.182483:0:14231:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787393250.182519:0:14231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787393250.200521:0:14231:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787393250.200588:0:14231:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787393250.200595:0:14231:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.121@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787393250.200770:0:14231:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787393250.200809:0:14231:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.121@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787393250.200814:0:14231:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787393250.200815:0:14231:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787393250.200816:0:14231:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787393250.200818:0:14231:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787393250.200819:0:14231:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787393250.200820:0:14231:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787393250.200822:0:14231:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787393250.200823:0:14231:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787393250.200824:0:14231:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787393250.200826:0:14231:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787393250.200828:0:14231:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787393250.200830:0:14231:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787393250.200832:0:14231:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787393250.200833:0:14231:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787393250.200834:0:14231:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787393250.200835:0:14231:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787393250.200836:0:14231:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787393250.200886:0:14231:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787393250.200887:0:14231:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787393250.200889:0:14231:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787393250.200890:0:14231:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787393250.200915:0:14231:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787393250.200934:0:14231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338488704:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787393250.201016:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393250.201341:0:14231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de807783e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787393250.201364:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338488704 00000100:00100000:0.0:1787393250.201473:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338488704 00000100:00100000:0.0:1787393250.201551:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787393250.201613:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f76d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+5:14231:x1874217338488704:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787393250.201683:0:14244:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787393250.201691:0:14244:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787393250.201695:0:14244:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787393250.214251:0:14265:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787393250.214792:0:14244:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1787393250.227802:0:14266:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787393250.227814:0:14266:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787393250.227817:0:14266:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787393250.227920:0:14266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787393250.234499:0:14244:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787393250.234527:0:14244:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787393250.275987:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f76d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+5:14231:x1874217338488704:12345-0@lo:253:mount.lustre.0 Request processed in 74365us (74965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393250.276005:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787393250.276470:0:14231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338488704:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787393250.276488:0:14231:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787393250.276493:0:14231:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787393250.276495:0:14231:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787393250.276496:0:14231:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787393250.276498:0:14231:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787393250.276499:0:14231:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787393250.276511:0:14231:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787393250.276513:0:14231:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787393250.276514:0:14231:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787393250.276516:0:14231:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787393250.276518:0:14231:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787393250.276545:0:14231:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9de83f587000 from lustre-MDT0000 10000000:01000000:1.0:1787393250.276588:0:14231:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787393250.276592:0:14231:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787393250.276597:0:14231:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9de8180eb380 10000000:01000000:1.0:1787393250.276603:0:14231:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787393250.276613:0:14231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9de8180eb380 from 1 10000000:01000000:1.0:1787393250.276617:0:14231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787393250.276663:0:14231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80385b400/0x19a927d9c62f2387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393250.276675:0:14231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de80385b400/0x19a927d9c62f2387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393250.276685:0:14231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de80385b400/0x19a927d9c62f2387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393250.276707:0:14231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338488832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787393250.276751:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393250.276826:0:14231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80763b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787393250.276831:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338488832 00000100:00100000:3.0:1787393250.276879:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338488832 00000100:00100000:3.0:1787393250.276931:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787393250.276941:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f76cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+5:14231:x1874217338488832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787393250.276968:0:14243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393250.276988:0:14243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de800030000/0x19a927d9c62f238e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f2387 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.277014:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de800030000/0x19a927d9c62f238e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f2387 expref: 6 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.277025:0:14243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de800030000/0x19a927d9c62f238e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f2387 expref: 6 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.277034:0:14243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800030000, rc 0) 00000100:00100000:3.0:1787393250.277122:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f76cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+6:14231:x1874217338488832:12345-0@lo:101:mount.lustre.0 Request processed in 183us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393250.277129:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787393250.277527:0:14231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338488832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787393250.278301:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de80385b400/0x19a927d9c62f2387 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f238e expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393250.278318:0:14231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de80385b400/0x19a927d9c62f2387 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f238e expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393250.286422:0:14231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338488960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787393250.286534:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393250.286596:0:14231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787393250.287132:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338488960 00000100:00100000:1.0:1787393250.287142:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338488960 00000100:00100000:1.0:1787393250.287317:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787393250.287328:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f76ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+6:14231:x1874217338488960:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787393250.287688:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f76ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+6:14231:x1874217338488960:12345-0@lo:501:mount.lustre.0 Request processed in 361us (1152us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787393250.287697:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787393250.290086:0:14231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338488960:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787393250.290143:0:14231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787393250.290279:0:14231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80385b400/0x19a927d9c62f2387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f238e expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.290292:0:14231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de80385b400/0x19a927d9c62f2387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f238e expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393250.290304:0:14231:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9de83f587000 10000000:01000000:0.0:1787393250.290314:0:14231:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787393250.290321:0:14231:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9de83f587000 10000000:01000000:0.0:1787393250.290323:0:14231:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787393250.290327:0:14231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9de83f587000 from 1 10000000:01000000:0.0:1787393250.290330:0:14231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787393250.290385:0:14231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80761ce00/0x19a927d9c62f2395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.290395:0:14231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de80761ce00/0x19a927d9c62f2395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.290425:0:14231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de80761ce00/0x19a927d9c62f2395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393250.290450:0:14231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338489088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787393250.290530:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393250.290589:0:14231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787393250.291406:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338489088 00000100:00100000:1.0:1787393250.291418:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338489088 00000100:00100000:1.0:1787393250.291489:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787393250.291500:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f76e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+6:14231:x1874217338489088:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787393250.291524:0:14243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393250.291548:0:14243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80385a400/0x19a927d9c62f239c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f2395 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393250.291578:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80385a400/0x19a927d9c62f239c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f2395 expref: 7 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393250.291591:0:14243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80385a400/0x19a927d9c62f239c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f2395 expref: 7 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393250.291601:0:14243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385a400, rc 0) 00000100:00100000:1.0:1787393250.291680:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f76e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+7:14231:x1874217338489088:12345-0@lo:101:mount.lustre.0 Request processed in 182us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393250.291688:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787393250.291902:0:14231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338489088:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787393250.291921:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de80761ce00/0x19a927d9c62f2395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f239c expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393250.291930:0:14231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de80761ce00/0x19a927d9c62f2395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f239c expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393250.291958:0:14231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787393250.291966:0:14231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80761ce00/0x19a927d9c62f2395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f239c expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393250.291974:0:14231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de80761ce00/0x19a927d9c62f2395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f239c expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393250.291981:0:14231:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787393250.291986:0:14231:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787393250.291991:0:14231:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9de83f587000 10000000:01000000:2.0:1787393250.291994:0:14231:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787393250.291997:0:14231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787393250.292000:0:14231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787393250.292024:0:14231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8186b4200/0x19a927d9c62f23a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393250.292032:0:14231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8186b4200/0x19a927d9c62f23a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393250.292040:0:14231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8186b4200/0x19a927d9c62f23a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393250.292058:0:14231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338489216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787393250.292323:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393250.292374:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338489216 00000100:00100000:2.0:1787393250.292379:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338489216 00000100:00100000:2.0:1787393250.292407:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787393250.292414:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f76e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+7:14231:x1874217338489216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787393250.292423:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393250.292435:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8186b4400/0x19a927d9c62f23aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f23a3 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393250.292452:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8186b4400/0x19a927d9c62f23aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f23a3 expref: 8 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393250.292461:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8186b4400/0x19a927d9c62f23aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f23a3 expref: 8 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393250.292467:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4400, rc 0) 00000100:00100000:2.0:1787393250.292493:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f76e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+8:14231:x1874217338489216:12345-0@lo:101:mount.lustre.0 Request processed in 79us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393250.292499:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787393250.292550:0:14231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80801b600 going to sleep for 11 seconds 00000100:00100000:2.0:1787393250.292562:0:14231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338489216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787393250.292571:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8186b4200/0x19a927d9c62f23a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f23aa expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393250.292579:0:14231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8186b4200/0x19a927d9c62f23a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f23aa expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393250.292637:0:14231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338489344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787393250.292669:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393250.292688:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338489344 00000100:00100000:2.0:1787393250.292691:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338489344 00000100:00100000:2.0:1787393250.292710:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787393250.292716:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f76f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+8:14231:x1874217338489344:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787393250.295150:0:14231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80801b600 going to sleep for 11 seconds 00000100:00100000:2.0:1787393250.297543:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f76f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+9:14231:x1874217338489344:12345-0@lo:501:mount.lustre.0 Request processed in 4813us (4859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393250.297560:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787393250.298484:0:14231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338489344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787393250.298571:0:14231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338489472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787393250.298655:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393250.298692:0:14231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83d57dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393250.299026:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338489472 00000100:00100000:1.0:1787393250.299036:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338489472 00000100:00100000:1.0:1787393250.299104:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787393250.299114:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+9:14231:x1874217338489472:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787393250.299690:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+9:14231:x1874217338489472:12345-0@lo:503:mount.lustre.0 Request processed in 576us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393250.299700:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787393250.299934:0:14231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338489472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787393250.310686:0:14267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14267:1874217338489600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787393250.310803:0:14267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393250.312133:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338489600 00000100:00100000:2.0:1787393250.312148:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338489600 00000100:00100000:2.0:1787393250.312329:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787393250.312341:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+9:14267:x1874217338489600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787393250.312771:0:14267:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83d57d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787393250.314423:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+9:14267:x1874217338489600:12345-0@lo:502:llog_process_th.0 Request processed in 2075us (3611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393250.314439:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787393250.314828:0:14267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14267:1874217338489600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787393250.314906:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787393250.314931:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393250.314934:0:14267:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787393250.314948:0:14267:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787393250.314952:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787393250.314970:0:14267:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9de834ed4d40) 00000020:00000080:3.0:1787393250.314995:0:14267:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787393250.315000:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787393250.315108:0:14267:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787393250.315117:0:14267:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a927d9c62f23b8 00000020:00000080:2.0:1787393250.325076:0:14267:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787393250.325090:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787393250.325097:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393250.325099:0:14267:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787393250.325103:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787393250.325110:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393250.325111:0:14267:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787393250.325115:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787393250.325130:0:14267:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9de83f804d40) 00000020:00000080:2.0:1787393250.325150:0:14267:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787393250.325155:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787393250.325157:0:14267:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787393250.325159:0:14267:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787393250.325166:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787393250.325237:0:14267:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9de83f587000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787393250.325250:0:14267:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9de83f800000) 00000020:00000080:2.0:1787393250.325258:0:14267:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787393250.325321:0:14267:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787393250.325327:0:14267:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a927d9c62f23cd 00000020:00000080:2.0:1787393250.325426:0:14267:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787393250.325431:0:14267:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787393250.325435:0:14267:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x19a927d9c62f23d4 00080000:01000000:2.0:1787393250.325440:0:14267:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787393250.325443:0:14267:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a927d9c62f23db 00010000:00010000:2.0:1787393250.420047:0:14267:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787393250.421916:0:14267:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1787393250.422266:0:14267:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787393250.422816:0:14267:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9de83f8019c0) 00000020:00000080:2.0:1787393250.422834:0:14267:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787393250.422919:0:14267:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787393250.422926:0:14267:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a927d9c62f23e9 00000020:00000080:2.0:1787393250.425322:0:14267:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787393250.434399:0:14267:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x19a927d9c62f23f0 00000020:00000080:2.0:1787393250.434686:0:14267:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787393250.434699:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787393250.434704:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393250.434706:0:14267:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787393250.434709:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787393250.434715:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393250.434716:0:14267:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787393250.434720:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787393250.434750:0:14267:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787393250.434760:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787393250.434762:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393250.434763:0:14267:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787393250.434766:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787393250.434773:0:14267:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1787393250.434775:0:14267:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787393250.434776:0:14267:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787393250.434778:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787393250.434780:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393250.434790:0:14267:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787393250.434793:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787393250.434796:0:14267:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787393250.434800:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393250.434801:0:14267:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787393250.434804:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787393250.434809:0:14267:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.121@tcp to nid 0x20000c0a8cb79 (192.168.203.121@tcp) 00000020:01000000:2.0:1787393250.434831:0:14267:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787393250.434833:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787393250.434878:0:14267:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9de836423380) 00000020:00000080:2.0:1787393250.434893:0:14267:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787393250.434899:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787393250.434952:0:14267:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787393250.434957:0:14267:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787393250.434962:0:14267:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a927d9c62f23fe 00010000:00080000:2.0:1787393250.434987:0:14267:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9de83b440000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.121@tcp at head 00010000:00010000:2.0:1787393250.435193:0:14267:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787393250.435682:0:14267:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787393250.435724:0:14267:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787393250.437526:0:14267:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787393250.437600:0:14267:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787393250.437706:0:14267:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787393250.450809:0:14271:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787393250.450819:0:14271:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787393250.451352:0:14267:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787393250.451364:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787393250.451398:0:14267:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787393250.451416:0:14267:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a927d9c62f2405 00000100:00080000:1.0:1787393250.451425:0:14267:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787393250.451431:0:14267:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9de83b440000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:1.0:1787393250.451464:0:14267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de835329f80 x1874217338489728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787393250.451514:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338489728:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787393250.451565:0:3323:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874217338489728 offset 0 length 520: 4 00000100:00080000:1.0:1787393250.451625:0:14267:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787393250.451668:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787393250.451672:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393250.451674:0:14267:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787393250.451677:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787393250.451680:0:14267:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1787393250.451682:0:14267:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787393250.451683:0:14267:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787393250.451695:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787393250.451698:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393250.451699:0:14267:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787393250.451702:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787393250.451706:0:14267:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787393250.451710:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393250.451712:0:14267:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787393250.451714:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787393250.451718:0:14267:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.121@tcp to nid 0x20000c0a8cb79 (192.168.203.121@tcp) 00000020:01000000:1.0:1787393250.451738:0:14267:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787393250.451741:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787393250.451752:0:14267:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9de8180899c0) 00000020:00000080:1.0:1787393250.451764:0:14267:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787393250.451769:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787393250.451825:0:14267:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787393250.451830:0:14267:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787393250.451860:0:14267:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19a927d9c62f2413 00010000:00080000:1.0:1787393250.451891:0:14267:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9de80929d800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.121@tcp at head 00010000:00010000:1.0:1787393250.452080:0:14267:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787393250.452253:0:14267:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787393250.452275:0:14267:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787393250.452813:0:14267:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787393250.452904:0:14267:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787393250.452969:0:14267:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1787393250.453278:0:14273:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787393250.453282:0:14273:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787393250.453543:0:14267:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787393250.453552:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787393250.453578:0:14267:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787393250.453592:0:14267:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a927d9c62f241a 00000100:00080000:1.0:1787393250.453600:0:14267:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787393250.453605:0:14267:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9de80929d800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:1.0:1787393250.453637:0:14267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de835328a80 x1874217338489856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787393250.453655:0:14267:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787393250.453691:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787393250.453695:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393250.453697:0:14267:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787393250.453699:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787393250.453702:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393250.453704:0:14267:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787393250.453706:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787393250.453708:0:14267:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787393250.453710:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787393250.453712:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393250.453713:0:14267:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787393250.453715:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787393250.453717:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393250.453718:0:14267:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787393250.453722:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787393250.453748:0:14267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14267:1874217338489984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393250.453814:0:14267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393250.453835:0:14267:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de803f9c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787393250.453877:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338489856:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787393250.453898:0:3323:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874217338489856 offset 0 length 520: 4 00000100:00100000:1.0:1787393250.453925:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338489984 00000100:00100000:1.0:1787393250.453932:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338489984 00000100:00100000:1.0:1787393250.453965:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787393250.453972:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+9:14267:x1874217338489984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393250.454160:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+9:14267:x1874217338489984:12345-0@lo:502:llog_process_th.0 Request processed in 187us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393250.454175:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787393250.454222:0:14267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14267:1874217338489984:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787393250.454245:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787393250.454248:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393250.454250:0:14267:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787393250.454254:0:14267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787393250.459907:0:14231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787393250.459945:0:14231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787393250.459967:0:14231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8186b4200/0x19a927d9c62f23a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f23aa expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.459981:0:14231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8186b4200/0x19a927d9c62f23a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f23aa expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393250.459989:0:14231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9de83f587000 from 1 10000000:01000000:0.0:1787393250.459993:0:14231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787393250.460032:0:14231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80761d400/0x19a927d9c62f2421 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.460041:0:14231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de80761d400/0x19a927d9c62f2421 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.460053:0:14231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de80761d400/0x19a927d9c62f2421 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393250.460079:0:14231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835256680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338490112:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787393250.460168:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393250.460218:0:14231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787393250.460396:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338490112 00000100:00100000:2.0:1787393250.460404:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338490112 00000100:00100000:2.0:1787393250.460449:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787393250.460459:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c04fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+9:14231:x1874217338490112:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787393250.460474:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393250.460494:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8186b5600/0x19a927d9c62f2428 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f2421 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393250.460529:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8186b5600/0x19a927d9c62f2428 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f2421 expref: 10 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393250.460539:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8186b5600/0x19a927d9c62f2428 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f2421 expref: 10 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393250.460548:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5600, rc 0) 00000100:00100000:2.0:1787393250.460587:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c04fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+10:14231:x1874217338490112:12345-0@lo:101:mount.lustre.0 Request processed in 130us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393250.460594:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787393250.460755:0:14231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835256680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338490112:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787393250.460768:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de80761d400/0x19a927d9c62f2421 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2428 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.460778:0:14231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de80761d400/0x19a927d9c62f2421 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f2428 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393250.461732:0:14231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835256680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338490240:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787393250.461779:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393250.461822:0:14231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787393250.461935:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338490240 00000100:00100000:2.0:1787393250.461941:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338490240 00000100:00100000:2.0:1787393250.461971:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787393250.461979:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c04c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+10:14231:x1874217338490240:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787393250.461994:0:14244:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787393250.462001:0:14244:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787393250.462065:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c04c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+10:14231:x1874217338490240:12345-0@lo:256:mount.lustre.0 Request processed in 87us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393250.462072:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787393250.463645:0:14231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835256680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338490240:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787393250.464455:0:14231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787393250.464467:0:14231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80761d400/0x19a927d9c62f2421 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2428 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.464478:0:14231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de80761d400/0x19a927d9c62f2421 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2428 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393250.464486:0:14231:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de83f587000 from 1 10000000:01000000:0.0:1787393250.464489:0:14231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787393250.464536:0:14231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80761cc00/0x19a927d9c62f242f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.464544:0:14231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de80761cc00/0x19a927d9c62f242f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.464569:0:14231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de80761cc00/0x19a927d9c62f242f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393250.464589:0:14231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835256680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338490368:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787393250.464646:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393250.464730:0:14231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787393250.465422:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338490368 00000100:00100000:2.0:1787393250.465429:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338490368 00000100:00100000:2.0:1787393250.465480:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787393250.465489:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c04d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+10:14231:x1874217338490368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787393250.465513:0:14243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393250.465530:0:14243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8186b4e00/0x19a927d9c62f2436 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f242f expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393250.465566:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8186b4e00/0x19a927d9c62f2436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f242f expref: 11 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393250.465578:0:14243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8186b4e00/0x19a927d9c62f2436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f242f expref: 11 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393250.465588:0:14243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4e00, rc 0) 00000100:00100000:2.0:1787393250.465695:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c04d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+11:14231:x1874217338490368:12345-0@lo:101:mount.lustre.0 Request processed in 207us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393250.465701:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787393250.466282:0:14231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835256680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338490368:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787393250.466296:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de80761cc00/0x19a927d9c62f242f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2436 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393250.466305:0:14231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de80761cc00/0x19a927d9c62f242f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f2436 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393250.466360:0:14231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338490496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787393250.466390:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393250.466451:0:14231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80639f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787393250.466480:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338490496 00000100:00100000:2.0:1787393250.466485:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338490496 00000100:00100000:2.0:1787393250.466559:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787393250.466567:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c04d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+11:14231:x1874217338490496:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787393250.467230:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c04d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+11:14231:x1874217338490496:12345-0@lo:501:mount.lustre.0 Request processed in 663us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393250.467237:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787393250.467381:0:14231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338490496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787393250.467411:0:14231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338490624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787393250.467448:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393250.467478:0:14231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80639f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787393250.467517:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338490624 00000100:00100000:2.0:1787393250.467522:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338490624 00000100:00100000:2.0:1787393250.467553:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787393250.467560:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c04f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+11:14231:x1874217338490624:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787393250.467738:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c04f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+11:14231:x1874217338490624:12345-0@lo:503:mount.lustre.0 Request processed in 178us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393250.467745:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787393250.473385:0:14231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338490624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787393250.474295:0:14275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14275:1874217338490752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393250.474371:0:14275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393250.474412:0:14275:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80639f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787393250.475173:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338490752 00000100:00100000:3.0:1787393250.475183:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338490752 00000100:00100000:3.0:1787393250.475234:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787393250.475244:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c04c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+11:14275:x1874217338490752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787393250.475557:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c04c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+11:14275:x1874217338490752:12345-0@lo:502:llog_process_th.0 Request processed in 314us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393250.475565:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787393250.475582:0:14275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14275:1874217338490752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787393250.475608:0:14275:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787393250.475618:0:14275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393250.475621:0:14275:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787393250.475628:0:14275:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9de83f587000 00000020:00000080:1.0:1787393250.475630:0:14275:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787393250.475637:0:14275:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787393250.475639:0:14275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393250.475641:0:14275:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787393250.475643:0:14275:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787393250.475645:0:14275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393250.475647:0:14275:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787393250.475650:0:14275:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9de83f587000 00000020:00000080:1.0:1787393250.475652:0:14275:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787393250.475706:0:14275:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787393250.475710:0:14275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393250.475711:0:14275:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787393250.475713:0:14275:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787393250.475715:0:14275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393250.475717:0:14275:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787393250.475720:0:14275:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9de83f587000 00000020:00000080:1.0:1787393250.475722:0:14275:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787393250.476297:0:14275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14275:1874217338490880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393250.476344:0:14275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393250.476379:0:14275:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80639f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787393250.476429:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338490880 00000100:00100000:0.0:1787393250.476434:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338490880 00000100:00100000:0.0:1787393250.476474:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787393250.476481:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c04e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+11:14275:x1874217338490880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787393250.476656:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c04e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+11:14275:x1874217338490880:12345-0@lo:502:llog_process_th.0 Request processed in 175us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393250.476663:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787393250.476900:0:14275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14275:1874217338490880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787393250.476921:0:14275:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787393250.476927:0:14275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393250.476929:0:14275:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787393250.476933:0:14275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787393250.477040:0:14231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787393250.477063:0:14231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787393250.477079:0:14231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80761cc00/0x19a927d9c62f242f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2436 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.477091:0:14231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de80761cc00/0x19a927d9c62f242f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2436 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393250.477137:0:14231:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787393250.477140:0:14231:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9de83f587000 10000000:01000000:0.0:1787393250.477143:0:14231:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9de83f587000 10000000:01000000:0.0:1787393250.477146:0:14231:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787393250.477151:0:14231:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9de83f587000 from 1 10000000:01000000:0.0:1787393250.477154:0:14231:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787393250.477182:0:14231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80761c600/0x19a927d9c62f243d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.477191:0:14231:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de80761c600/0x19a927d9c62f243d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.477316:0:14231:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de80761c600/0x19a927d9c62f243d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393250.477332:0:14231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338491008:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787393250.477362:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393250.477391:0:14231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787393250.477533:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338491008 00000100:00100000:3.0:1787393250.477538:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338491008 00000100:00100000:3.0:1787393250.477571:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787393250.477578:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+11:14231:x1874217338491008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787393250.477587:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393250.477599:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de800030800/0x19a927d9c62f2444 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f243d expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.477630:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de800030800/0x19a927d9c62f2444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f243d expref: 12 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.477639:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de800030800/0x19a927d9c62f2444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f243d expref: 12 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.477648:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800030800, rc 0) 00000100:00100000:3.0:1787393250.477678:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14231:x1874217338491008:12345-0@lo:101:mount.lustre.0 Request processed in 101us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393250.477685:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787393250.478021:0:14231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338491008:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787393250.478032:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de80761c600/0x19a927d9c62f243d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2444 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.478040:0:14231:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de80761c600/0x19a927d9c62f243d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f2444 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393250.478080:0:14231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338491136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787393250.478113:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393250.478137:0:14231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787393250.478147:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338491136 00000100:00100000:3.0:1787393250.478151:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338491136 00000100:00100000:3.0:1787393250.478179:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787393250.478186:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14231:x1874217338491136:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787393250.478419:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14231:x1874217338491136:12345-0@lo:501:mount.lustre.0 Request processed in 232us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393250.478426:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787393250.478544:0:14231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338491136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787393250.478570:0:14231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338491264:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787393250.478603:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393250.478624:0:14231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1600 going to sleep for 11 seconds 00000100:00100000:1.0:1787393250.478669:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338491264 00000100:00100000:1.0:1787393250.478673:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338491264 00000100:00100000:1.0:1787393250.478700:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787393250.478706:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14231:x1874217338491264:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787393250.478834:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14231:x1874217338491264:12345-0@lo:503:mount.lustre.0 Request processed in 128us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393250.479188:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787393250.480226:0:14231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338491264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787393250.484518:0:14276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14276:1874217338491392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787393250.484606:0:14276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393250.484648:0:14276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80639fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787393250.492280:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338491392 00000100:00100000:3.0:1787393250.492296:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338491392 00000100:00100000:3.0:1787393250.492355:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787393250.492366:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14276:x1874217338491392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787393250.492671:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14276:x1874217338491392:12345-0@lo:502:llog_process_th.0 Request processed in 306us (8064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393250.492679:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787393250.492745:0:14276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14276:1874217338491392:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787393250.492810:0:14276:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787393250.492824:0:14276:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9de834ed0000) 00000020:00000080:3.0:1787393250.492871:0:14276:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1787393250.493012:0:14276:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9de83f587000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787393250.493016:0:14276:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9de83f587000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787393250.493018:0:14276:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9de83f587000 4 00010000:00080000:3.0:1787393250.493046:0:14276:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9de834e0c800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.121@tcp at head 00010000:00010000:3.0:1787393250.494588:0:14276:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787393250.494694:0:14276:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787393250.494726:0:14276:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787393250.494736:0:14276:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x19a927d9c62f2452 00000100:00080000:3.0:1787393250.494746:0:14276:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787393250.494751:0:14276:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9de834e0c800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:3.0:1787393250.494785:0:14276:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de83f75f100 x1874217338491520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787393250.494814:0:14276:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787393250.494874:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3323:1874217338491520:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787393250.494932:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393250.497285:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338491520 00000100:00100000:2.0:1787393250.497299:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338491520 00000100:00100000:2.0:1787393250.497344:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787393250.497353:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3323:x1874217338491520:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787393250.497448:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3323:x1874217338491520:12345-0@lo:38:llog_process_th.0 Request processed in 95us (2515us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787393250.497455:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787393250.497522:0:3323:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787393250.497530:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de834e0c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787393250.497534:0:3323:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787393250.497538:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3323:1874217338491520:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787393250.499917:0:14276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835256a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14276:1874217338491648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787393250.500000:0:14276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393250.500027:0:14276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787393250.500050:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338491648 00000100:00100000:0.0:1787393250.500056:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338491648 00000100:00100000:0.0:1787393250.500093:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787393250.500101:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14276:x1874217338491648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787393250.501265:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14276:x1874217338491648:12345-0@lo:502:llog_process_th.0 Request processed in 390us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393250.501278:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787393250.501346:0:14276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835256a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14276:1874217338491648:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787393250.501382:0:14276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787393250.504681:0:14231:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787393250.504717:0:14231:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787393250.504795:0:14231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80761c600/0x19a927d9c62f243d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2444 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.504808:0:14231:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de80761c600/0x19a927d9c62f243d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2444 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787393250.504900:0:14231:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787393250.504907:0:14231:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787393250.504908:0:14231:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787393250.504909:0:14231:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787393250.504910:0:14231:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787393250.504912:0:14231:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787393250.504966:0:14231:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787393250.504968:0:14231:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787393250.504969:0:14231:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787393250.504971:0:14231:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787393250.504974:0:14231:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787393250.504977:0:14231:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787393250.504978:0:14231:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787393250.504978:0:14231:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787393250.504979:0:14231:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787393250.504980:0:14231:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787393250.504981:0:14231:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787393250.504982:0:14231:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787393250.504983:0:14231:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787393250.504984:0:14231:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787393250.504985:0:14231:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787393250.505011:0:14231:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787393250.505030:0:14231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338491776:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787393250.505092:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393250.505135:0:14231:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83d57da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787393250.506293:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338491776 00000100:00100000:1.0:1787393250.506303:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338491776 00000100:00100000:1.0:1787393250.506348:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787393250.506357:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14231:x1874217338491776:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787393250.506384:0:14242:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787393250.506398:0:14242:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787393250.596337:0:14242:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787393250.596363:0:14242:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787393250.597008:0:14265:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787393250.597019:0:14265:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787393250.597053:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9de80761d200/0x19a927d9c62f2459 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.597139:0:14265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de8186b5600/0x19a927d9c62f2428 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f2421 expref: 12 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.597149:0:14265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9de80761d200/0x19a927d9c62f2459 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.597202:0:14265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de8186b5600/0x19a927d9c62f2428 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f2421 expref: 12 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393250.597219:0:14265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de8186b5600/0x19a927d9c62f2428 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f2421 expref: 12 pid: 14242 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393250.597238:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835256a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14265:1874217338491904:0@lo:104: 00000100:00100000:0.0:1787393250.597339:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393250.597792:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351f1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393250.603544:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338491904 00000100:00100000:1.0:1787393250.603567:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338491904 00000100:00100000:1.0:1787393250.603648:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787393250.603660:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+3:14265:x1874217338491904:12345-0@lo:104: 00010000:00010000:1.0:1787393250.603681:0:14232:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de80761d400/0x19a927d9c62f2421 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f2428 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393250.603806:0:14232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787393250.603814:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+3:14265:x1874217338491904:12345-0@lo:104: Request processed in 157us (6475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393250.603825:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787393250.603830:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393250.603880:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de80761d400/0x19a927d9c62f2421 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f2428 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.603892:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761d400 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1787393250.603896:0:14238:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de80761d400/0x19a927d9c62f2421 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f2428 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.603906:0:14238:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de80761d400/0x19a927d9c62f2421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f2428 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787393250.603912:0:14238:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de80761d400/0x19a927d9c62f2421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f2428 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393250.603935:0:14238:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787393250.604000:0:14238:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de80761d400/0x19a927d9c62f2421 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2428 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.604007:0:14238:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787393250.604039:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de80761d400/0x19a927d9c62f2421 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2428 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.604047:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de80761d400/0x19a927d9c62f2421 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2428 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.604069:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393250.604070:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393250.604072:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393250.604099:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787393250.604128:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3325:1874217338492032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787393250.604318:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393250.604388:0:14234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338492032 00000100:00100000:3.0:1787393250.604395:0:14234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338492032 00010000:00010000:3.0:1787393250.604431:0:14234:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de8186b5600/0x19a927d9c62f2428 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f2421 expref: 13 pid: 14242 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393250.604462:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787393250.604470:0:14234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+13:3325:x1874217338492032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787393250.604481:0:14234:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393250.604485:0:14234:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de8186b5600/0x19a927d9c62f2428 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f2421 expref: 13 pid: 14242 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.604496:0:14234:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de8186b5600/0x19a927d9c62f2428 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f2421 expref: 13 pid: 14242 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.604537:0:14234:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9de80761d200/0x19a927d9c62f2459 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.604545:0:14234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761d200/0x19a927d9c62f2459 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787393250.604561:0:14234:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007543549s 00010000:00010000:3.0:1787393250.604566:0:14234:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de80761d200/0x19a927d9c62f2459 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.604573:0:14234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de80761d200/0x19a927d9c62f2459 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.604578:0:14234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9de80761d200/0x19a927d9c62f2459 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.604584:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9de80761d200/0x19a927d9c62f2459 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.604590:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761d200 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393250.604593:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9de80761d200/0x19a927d9c62f2459 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.604598:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9de80761d200/0x19a927d9c62f2459 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.604606:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9de80761d200/0x19a927d9c62f2459 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.604619:0:14234:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393250.604664:0:14234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+13:3325:x1874217338492032:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393250.604678:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787393250.604729:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3325:1874217338492032:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787393250.604738:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8186b5600/0x19a927d9c62f2428 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f2421 expref: 12 pid: 14242 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393250.604753:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835256a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14265:1874217338491904:0@lo:104: 00010000:00010000:3.0:1787393250.604779:0:14265:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9de80761d200/0x19a927d9c62f2459 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.604789:0:14265:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9de80761d200/0x19a927d9c62f2459 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.604796:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9de80761d200/0x19a927d9c62f2459 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393250.604802:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80761d200/0x19a927d9c62f2459 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393250.620818:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+11:14231:x1874217338491776:12345-0@lo:253:mount.lustre.0 Request processed in 114394us (115657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393250.620819:0:14231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14231:1874217338491776:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787393250.620885:0:14231:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787393250.620889:0:14231:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787393250.620891:0:14231:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787393250.620893:0:14231:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787393250.620894:0:14231:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787393250.620897:0:14231:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787393250.620899:0:14231:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787393250.620901:0:14231:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787393250.620902:0:14231:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787393250.620904:0:14231:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787393250.620906:0:14231:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787393250.620924:0:14231:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787393250.620991:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00080000:10000000:2.0:1787393250.638681:0:14231:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787393250.638883:0:14231:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787393250.639150:0:14231:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787393250.639308:0:14231:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787393250.639597:0:14231:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787393250.639759:0:14231:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787393250.647151:0:14231:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787393250.647404:0:14231:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787393250.647716:0:14231:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787393250.647969:0:14231:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787393250.648234:0:14231:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787393250.648387:0:14231:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787393250.796354:0:14231:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787393250.797790:0:14231:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787393250.798017:0:14286:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787393250.798022:0:14286:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787393250.799333:0:14287:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787393250.799442:0:14287:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787393250.810699:0:14287:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787393250.810786:0:14287:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787393250.810790:0:14287:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1787393250.816558:0:14231:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787393250.816717:0:14231:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787393250.817604:0:14231:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787393250.817616:0:14231:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787393250.820009:0:14231:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787393250.822769:0:14231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787393250.825222:0:14231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787393250.825311:0:14231:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787393250.826986:0:14231:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1787393250.859757:0:14231:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787393250.957425:0:14231:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787393250.957464:0:14231:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbe5881d67988 00100000:10000000:1.0:1787393250.957471:0:14231:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787393250.958459:0:14231:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787393250.958474:0:14231:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.121@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787393250.958489:0:14231:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787393250.958518:0:14231:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787393250.993438:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787393251.367942:0:14246:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787393251.367949:0:14246:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9de83f587000 from 6 10000000:01000000:1.0:1787393251.367954:0:14246:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787393251.368006:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f2460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393251.368019:0:14246:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f2460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393251.368031:0:14246:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f2460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393251.368057:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338492160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787393251.368121:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393251.368166:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de803ea4780 going to sleep for 11 seconds 00000100:00100000:1.0:1787393251.368187:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338492160 00000100:00100000:1.0:1787393251.368193:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338492160 00000100:00100000:1.0:1787393251.368238:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787393251.368246:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+11:14246:x1874217338492160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787393251.368258:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393251.368271:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80385b200/0x19a927d9c62f2467 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f2460 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393251.368292:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80385b200/0x19a927d9c62f2467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f2460 expref: 12 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393251.368303:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80385b200/0x19a927d9c62f2467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f2460 expref: 12 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393251.368312:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385b200, rc 0) 00000100:00100000:1.0:1787393251.368354:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14246:x1874217338492160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393251.368360:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787393251.368413:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338492160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787393251.368427:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f2460 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2467 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393251.368435:0:14246:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f2460 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f2467 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393251.368483:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338492288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787393251.380104:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393251.380159:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351c29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787393251.380233:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338492288 00000100:00100000:3.0:1787393251.380241:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338492288 00000100:00100000:3.0:1787393251.380287:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787393251.380296:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14246:x1874217338492288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787393251.380320:0:14242:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787393251.380342:0:14242:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787393251.380346:0:14242:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787393251.380450:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14246:x1874217338492288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 153us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393251.380458:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787393251.380549:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338492288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787393251.380601:0:14246:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787393251.380610:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f2460 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2467 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393251.380621:0:14246:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f2460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2467 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787393251.560509:0:14283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787393252.008817:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787393252.586209:0:14283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787393253.043918:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393254.070623:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393255.085785:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787393255.784473:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787393255.784480:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787393255.784483:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787393255.784486:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787393255.784489:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787393255.784492:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787393255.784496:0:38:0:(import.c:65:import_set_state_nolock()) ffff9de834e0c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787393255.784509:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9de834e0c800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:3.0:1787393255.784530:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de83f75f800 x1874217338492544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787393255.784681:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3323:1874217338492544:0@lo:38:kworker.0 00000100:00100000:3.0:1787393255.784746:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393255.784853:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338492544 00000100:00100000:3.0:1787393255.784862:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338492544 00000100:00100000:3.0:1787393255.784893:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787393255.784901:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3323:x1874217338492544:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787393255.784927:0:14251:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 404 last 0 00000020:00000080:3.0:1787393255.784964:0:14251:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x19a927d9c62f246e 00000004:00100000:3.0:1787393255.784979:0:14251:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787393255.785104:0:14251:0:(import.c:65:import_set_state_nolock()) ffff9de83ca36800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787393255.789013:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3325:1874217338492416:0@lo:400:kworker.0 00000100:00100000:2.0:1787393255.789093:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393255.790264:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338492416 00000100:00100000:0.0:1787393255.790274:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338492416 00000100:00100000:0.0:1787393255.790328:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787393255.790337:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:3325:x1874217338492416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393255.790405:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:3325:x1874217338492416:12345-0@lo:400:kworker.0 Request processed in 69us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393255.790411:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787393255.790461:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3325:1874217338492416:0@lo:400:kworker.0 00000100:00100000:3.0:1787393255.795681:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1874217338492544:12345-0@lo:38:kworker.0 Request processed in 252us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393255.795696:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787393255.795860:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9de83f75f800 x1874217338492544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787393265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787393255.795880:0:3323:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787393255.795889:0:3323:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787393255.795894:0:3323:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787393255.795897:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de834e0c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787393255.795904:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3323:1874217338492544:0@lo:38:kworker.0 00010000:00010000:3.0:1787393256.113108:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787393256.600240:0:14532:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787393257.130752:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393258.154885:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393259.177669:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787393259.805902:0:14682:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe128c7550 00000020:00000080:0.0:1787393259.805919:0:14682:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787393259.805924:0:14682:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787393259.805932:0:14682:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe128c97e0 20000000:00000080:0.0:1787393259.805940:0:14682:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9de83d8be400 uarg=0000000000000000 20000000:01000000:0.0:1787393259.805980:0:14682:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787393259.805988:0:14682:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787393259.805992:0:14682:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787393259.811497:0:14683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1787393259.811955:0:14682:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787393259.825293:0:14682:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787393259.829783:0:14682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9de80761c400/0x19a927d9c62f2475 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393259.829807:0:14682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de8186b4e00/0x19a927d9c62f2436 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f242f expref: 11 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393259.829816:0:14682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9de80761c400/0x19a927d9c62f2475 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393259.830425:0:14682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de8186b4e00/0x19a927d9c62f2436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f242f expref: 11 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393259.830454:0:14682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de8186b4e00/0x19a927d9c62f2436 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f242f expref: 11 pid: 14243 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393259.830470:0:14682:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835255c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14682:1874217338492672:0@lo:104: 00000100:00100000:0.0:1787393259.830529:0:14682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393259.830701:0:14682:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de81032f000 going to sleep for 11 seconds 00000100:00100000:2.0:1787393259.833615:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338492672 00000100:00100000:2.0:1787393259.833631:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338492672 00000100:00100000:2.0:1787393259.833805:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787393259.833817:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+3:14682:x1874217338492672:12345-0@lo:104: 00010000:00010000:2.0:1787393259.833833:0:14233:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de80761cc00/0x19a927d9c62f242f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f2436 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393259.833949:0:14233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787393259.833956:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+3:14682:x1874217338492672:12345-0@lo:104: Request processed in 143us (3427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393259.833963:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787393259.834051:0:14682:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835255c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14682:1874217338492672:0@lo:104: 00010000:00010000:1.0:1787393259.834074:0:14682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9de80761c400/0x19a927d9c62f2475 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834209:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393259.834216:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de80761cc00/0x19a927d9c62f242f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f2436 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834224:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761cc00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1787393259.834251:0:14238:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de80761cc00/0x19a927d9c62f242f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f2436 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834260:0:14238:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de80761cc00/0x19a927d9c62f242f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f2436 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787393259.834267:0:14238:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de80761cc00/0x19a927d9c62f242f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f2436 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393259.834273:0:14238:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787393259.834306:0:14238:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de80761cc00/0x19a927d9c62f242f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2436 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834321:0:14238:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787393259.834342:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de80761cc00/0x19a927d9c62f242f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2436 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834348:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de80761cc00/0x19a927d9c62f242f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2436 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834364:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393259.834365:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393259.834367:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393259.834393:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3326:1874217338492800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787393259.834432:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393259.834511:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338492800 00000100:00100000:3.0:1787393259.834515:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338492800 00010000:00010000:3.0:1787393259.834534:0:14235:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de8186b4e00/0x19a927d9c62f2436 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f242f expref: 12 pid: 14243 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393259.834553:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787393259.834583:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:3326:x1874217338492800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787393259.834593:0:14235:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393259.834599:0:14235:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de8186b4e00/0x19a927d9c62f2436 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f242f expref: 12 pid: 14243 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834609:0:14235:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de8186b4e00/0x19a927d9c62f2436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f242f expref: 12 pid: 14243 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834622:0:14235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8186b4e00/0x19a927d9c62f2436 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f242f expref: 12 pid: 14243 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834635:0:14235:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9de80761c400/0x19a927d9c62f2475 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834643:0:14235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761c400/0x19a927d9c62f2475 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834657:0:14235:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de80761c400/0x19a927d9c62f2475 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834664:0:14235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de80761c400/0x19a927d9c62f2475 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834671:0:14235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9de80761c400/0x19a927d9c62f2475 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834677:0:14235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9de80761c400/0x19a927d9c62f2475 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834683:0:14235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761c400 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393259.834687:0:14235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9de80761c400/0x19a927d9c62f2475 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834699:0:14235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9de80761c400/0x19a927d9c62f2475 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834710:0:14235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9de80761c400/0x19a927d9c62f2475 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393259.834718:0:14235:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393259.834747:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+11:3326:x1874217338492800:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393259.834755:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787393259.834784:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3326:1874217338492800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787393259.834913:0:14682:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9de80761c400/0x19a927d9c62f2475 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393259.834922:0:14682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9de80761c400/0x19a927d9c62f2475 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393259.834928:0:14682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80761c400/0x19a927d9c62f2475 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393260.200468:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393260.905191:0:3323:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787393250/real 1787393250] req@ffff9de835328a80 x1874217338489856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787393260 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393260.905264:0:3323:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9de835328a80 x1874217338489856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787393260 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393260.905273:0:3323:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787393250/real 1787393250] req@ffff9de835329f80 x1874217338489728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787393260 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393260.905284:0:3323:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9de835329f80 x1874217338489728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787393260 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787393260.905317:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de80929d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787393260.916416:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787393260.916423:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787393260.916426:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787393260.916438:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787393260.916442:0:36:0:(import.c:65:import_set_state_nolock()) ffff9de80929d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787393260.916450:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 399 00000100:00080000:2.0:1787393260.916455:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787393260.916462:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9de80929d800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:2.0:1787393260.916479:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3327:1874217338492928:0@lo:400:kworker.0 00000100:00100000:2.0:1787393260.916545:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393260.916625:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338492928 00000100:00100000:2.0:1787393260.916633:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338492928 00000100:00100000:2.0:1787393260.916680:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787393260.916699:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+11:3327:x1874217338492928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393260.916749:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+11:3327:x1874217338492928:12345-0@lo:400:kworker.0 Request processed in 50us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393260.916756:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787393260.916802:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3327:1874217338492928:0@lo:400:kworker.0 00000100:00100000:2.0:1787393260.916863:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de83c5a7800 x1874217338493056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787393260.916912:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338493184:0@lo:400:kworker.0 00000100:00100000:2.0:1787393260.916940:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393260.916992:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338493184 00000100:00100000:2.0:1787393260.916996:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338493184 00000100:00100000:2.0:1787393260.917021:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787393260.917027:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338493184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393260.917063:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338493184:12345-0@lo:400:kworker.0 Request processed in 35us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393260.917069:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787393260.917097:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9de83c5a6a00 x1874217338493184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393260.917108:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338493184:0@lo:400:kworker.0 00000100:00080000:0.0:1787393260.918054:0:3323:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787393260.918062:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338489856:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787393260.918152:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de83b440000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787393260.918160:0:3323:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787393260.918164:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338489728:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787393260.918188:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338493056:0@lo:8:kworker.0 00000400:00000100:0.0:1787393260.918225:0:3323:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874217338493056 offset 0 length 520: 4 00000100:00080000:2.0:1787393260.918559:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787393260.918564:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787393260.918567:0:36:0:(import.c:65:import_set_state_nolock()) ffff9de83b440000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787393260.918572:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 399 00000100:00080000:2.0:1787393260.918576:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787393260.918590:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9de83b440000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:2.0:1787393260.918614:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de83c5a6a00 x1874217338493312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787393260.919330:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338493312:0@lo:8:kworker.0 00000400:00000100:3.0:1787393260.919364:0:3323:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874217338493312 offset 0 length 520: 4 00010000:00010000:1.0:1787393261.242770:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787393261.352001:0:14246:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787393261.352008:0:14246:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de83f587000 from 10 10000000:01000000:2.0:1787393261.352013:0:14246:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787393261.352060:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f247c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393261.352070:0:14246:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f247c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393261.352081:0:14246:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f247c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393261.352106:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338493440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787393261.352186:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393261.352245:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8187d19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787393261.352316:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338493440 00000100:00100000:0.0:1787393261.352334:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338493440 00000100:00100000:0.0:1787393261.352385:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787393261.352395:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+11:14246:x1874217338493440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787393261.352408:0:14243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393261.352434:0:14243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80761d800/0x19a927d9c62f2483 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f247c expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393261.352458:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761d800/0x19a927d9c62f2483 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f247c expref: 12 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393261.352468:0:14243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80761d800/0x19a927d9c62f2483 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f247c expref: 12 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393261.352477:0:14243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761d800, rc 0) 00000100:00100000:0.0:1787393261.352527:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14246:x1874217338493440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393261.352550:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787393261.352579:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338493440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787393261.352595:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f247c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2483 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393261.352604:0:14246:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f247c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f2483 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393261.352666:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338493568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393261.352694:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393261.352729:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a1480 going to sleep for 11 seconds 00000100:00100000:2.0:1787393261.352891:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338493568 00000100:00100000:2.0:1787393261.352896:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338493568 00000100:00100000:2.0:1787393261.352929:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787393261.352937:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14246:x1874217338493568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787393261.353171:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14246:x1874217338493568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393261.353178:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787393261.353497:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338493568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393261.353533:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338493696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787393261.353573:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393261.353640:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1787393261.359483:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338493696 00000100:00100000:0.0:1787393261.359498:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338493696 00000100:00100000:0.0:1787393261.359567:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787393261.359578:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14246:x1874217338493696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787393261.359820:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14246:x1874217338493696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (6245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393261.359827:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787393261.360153:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338493696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787393261.361184:0:14743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787393261.363336:0:14246:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787393261.363368:0:14246:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787393261.363378:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f247c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2483 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393261.363391:0:14246:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f247c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2483 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393262.249519:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787393262.844593:0:14283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787393263.282269:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393264.300450:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393265.320316:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787393265.525078:0:14883:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787393265.525082:0:14883:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787393265.525234:0:14883:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9de827af4800 00000020:01000004:1.0:1787393265.525248:0:14883:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787393265.525259:0:14883:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787393265.525272:0:14883:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9de81808b380) 00000020:00000080:1.0:1787393265.525286:0:14883:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787393265.583130:0:14883:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787393265.583369:0:14883:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787393265.585577:0:14883:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787393265.586005:0:14883:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787393265.586229:0:14883:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787393265.587104:0:14883:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1787393265.587200:0:14883:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1787393265.587327:0:14883:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1787393265.588292:0:14883:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 177: rc = 0 00100000:10000000:2.0:1787393265.593976:0:14883:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 177: rc = 0 00100000:10000000:2.0:1787393265.594355:0:14883:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 177: rc = 0 00100000:10000000:2.0:1787393265.594635:0:14883:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 177: rc = 0 00100000:10000000:2.0:1787393265.594912:0:14883:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 177: rc = 0 00100000:10000000:2.0:1787393265.595151:0:14883:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 177: rc = 0 00000020:00000080:2.0:1787393265.595739:0:14883:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787393265.595749:0:14883:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787393265.595760:0:14883:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x19a927d9c62f2491 00000020:01000004:2.0:1787393265.595767:0:14883:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787393265.595787:0:14883:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787393265.595791:0:14883:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787393265.595797:0:14883:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787393265.595802:0:14883:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787393265.595812:0:14883:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9de836424d40) 00000020:00000080:2.0:1787393265.595822:0:14883:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787393265.596933:0:14883:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787393265.597086:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787393265.597092:0:14883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787393265.601563:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787393265.601576:0:14883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787393265.609735:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787393265.609747:0:14883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787393265.614643:0:14883:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787393265.614832:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787393265.614860:0:14883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787393265.618037:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787393265.618048:0:14883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787393265.677290:0:14883:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787393265.677500:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787393265.677511:0:14883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787393265.682031:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787393265.682047:0:14883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787393265.685587:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787393265.685600:0:14883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787393265.694314:0:14883:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787393265.694596:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787393265.694601:0:14883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787393265.695462:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787393265.695473:0:14883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787393265.757610:0:14883:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787393265.758031:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787393265.758038:0:14883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787393265.760041:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787393265.760055:0:14883:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787393265.761246:0:14883:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787393265.761273:0:14883:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787393265.761279:0:14883:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.121@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787393265.780526:0:14883:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787393265.780574:0:14883:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.121@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787393265.780579:0:14883:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787393265.780580:0:14883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787393265.780582:0:14883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787393265.780583:0:14883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787393265.780584:0:14883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787393265.780586:0:14883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787393265.780587:0:14883:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787393265.780588:0:14883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787393265.780590:0:14883:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787393265.780593:0:14883:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787393265.780596:0:14883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787393265.780597:0:14883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787393265.780598:0:14883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787393265.780599:0:14883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787393265.780600:0:14883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787393265.780601:0:14883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787393265.780605:0:14883:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787393265.780606:0:14883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787393265.780607:0:14883:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787393265.780685:0:14883:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787393265.780705:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338493824:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787393265.780835:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393265.781078:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb59600 going to sleep for 11 seconds 00000100:00100000:0.0:1787393265.781178:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338493824 00000100:00100000:0.0:1787393265.781185:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338493824 00000100:00100000:0.0:1787393265.781256:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787393265.781264:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14883:x1874217338493824:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787393265.781363:0:14243:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787393265.781367:0:14243:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787393265.781370:0:14243:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787393265.795414:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14883:x1874217338493824:12345-0@lo:253:mount.lustre.0 Request processed in 14141us (14570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393265.795443:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787393265.795696:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338493824:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787393265.795712:0:14883:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787393265.795715:0:14883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787393265.795717:0:14883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787393265.795784:0:14883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787393265.795786:0:14883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787393265.795788:0:14883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787393265.795789:0:14883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787393265.795790:0:14883:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787393265.795792:0:14883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787393265.795794:0:14883:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787393265.795813:0:14883:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9de827af4800 from lustre-OST0000 10000000:01000000:1.0:1787393265.796038:0:14883:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787393265.796041:0:14883:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787393265.796047:0:14883:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9de8180eb380 local copy 00010000:00010000:1.0:1787393265.796057:0:14883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80385b400/0x19a927d9c62f2387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f238e expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393265.796407:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338493952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787393265.796452:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393265.796490:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb59600 going to sleep for 11 seconds 00000100:00100000:2.0:1787393265.796612:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338493952 00000100:00100000:2.0:1787393265.796675:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338493952 00000100:00100000:2.0:1787393265.796824:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787393265.796834:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14883:x1874217338493952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787393265.797033:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14883:x1874217338493952:12345-0@lo:501:mount.lustre.0 Request processed in 200us (579us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787393265.797041:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787393265.797117:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338493952:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787393265.797132:0:14883:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787393265.797250:0:14883:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787393265.797263:0:14883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80385b400/0x19a927d9c62f2387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f238e expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393265.797273:0:14883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de80385b400/0x19a927d9c62f2387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f238e expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393265.797293:0:14883:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9de827af4800 10000000:01000000:1.0:1787393265.797298:0:14883:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787393265.797311:0:14883:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9de8180eb380 10000000:01000000:1.0:1787393265.797315:0:14883:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787393265.797318:0:14883:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9de8180eb380 from 1 10000000:01000000:1.0:1787393265.797321:0:14883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787393265.797347:0:14883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80385ba00/0x19a927d9c62f249f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393265.797355:0:14883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de80385ba00/0x19a927d9c62f249f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393265.797366:0:14883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de80385ba00/0x19a927d9c62f249f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393265.797380:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338494080:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787393265.797417:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393265.798522:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338494080 00000100:00100000:0.0:1787393265.798537:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338494080 00000100:00100000:0.0:1787393265.798573:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787393265.798580:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f77fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+12:14883:x1874217338494080:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787393265.798593:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393265.798607:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80761de00/0x19a927d9c62f24a6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f249f expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393265.798629:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761de00/0x19a927d9c62f24a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f249f expref: 13 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393265.798640:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80761de00/0x19a927d9c62f24a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f249f expref: 13 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393265.798647:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761de00, rc 0) 00000100:00100000:0.0:1787393265.798684:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f77fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+13:14883:x1874217338494080:12345-0@lo:101:mount.lustre.0 Request processed in 105us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393265.798690:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787393265.798929:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb59600 going to sleep for 11 seconds 00000100:00100000:0.0:1787393265.798949:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338494080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787393265.798963:0:14883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de80385ba00/0x19a927d9c62f249f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f24a6 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393265.798972:0:14883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de80385ba00/0x19a927d9c62f249f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f24a6 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393265.799004:0:14883:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787393265.799021:0:14883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80385ba00/0x19a927d9c62f249f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f24a6 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393265.799029:0:14883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de80385ba00/0x19a927d9c62f249f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f24a6 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787393265.799036:0:14883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787393265.799039:0:14883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787393265.799045:0:14883:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787393265.799047:0:14883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787393265.799065:0:14883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80761c200/0x19a927d9c62f24ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393265.799072:0:14883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de80761c200/0x19a927d9c62f24ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393265.799080:0:14883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de80761c200/0x19a927d9c62f24ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393265.799095:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338494208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787393265.799120:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393265.799140:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338494208 00000100:00100000:0.0:1787393265.799143:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338494208 00000100:00100000:0.0:1787393265.799158:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787393265.799163:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f77f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+13:14883:x1874217338494208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787393265.799170:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393265.799181:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80761da00/0x19a927d9c62f24b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f24ad expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393265.799194:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761da00/0x19a927d9c62f24b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f24ad expref: 14 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393265.799202:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80761da00/0x19a927d9c62f24b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f24ad expref: 14 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393265.799210:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761da00, rc 0) 00000100:00100000:0.0:1787393265.799229:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f77f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+14:14883:x1874217338494208:12345-0@lo:101:mount.lustre.0 Request processed in 66us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393265.799234:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787393265.799257:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de807783d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787393265.799269:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338494208:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787393265.799278:0:14883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de80761c200/0x19a927d9c62f24ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f24b4 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393265.799285:0:14883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de80761c200/0x19a927d9c62f24ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f24b4 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787393265.800297:0:14883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787393265.802279:0:14883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787393265.804149:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787393265.804197:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787393265.804224:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787393265.804261:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787393265.804373:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787393265.804488:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787393265.804554:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787393265.804570:0:14883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787393265.804664:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338494336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787393265.804729:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393265.804933:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de807783d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787393265.804990:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338494336 00000100:00100000:1.0:1787393265.804997:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338494336 00000100:00100000:1.0:1787393265.805041:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787393265.805050:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f77cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+14:14883:x1874217338494336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787393265.805421:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f77cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+14:14883:x1874217338494336:12345-0@lo:501:mount.lustre.0 Request processed in 371us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393265.805438:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787393265.805501:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338494336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787393265.805541:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338494464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787393265.805579:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393265.805601:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de807783d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787393265.805651:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338494464 00000100:00100000:3.0:1787393265.805656:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338494464 00000100:00100000:3.0:1787393265.805722:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787393265.805730:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f77d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+14:14883:x1874217338494464:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787393265.806067:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f77d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+14:14883:x1874217338494464:12345-0@lo:503:mount.lustre.0 Request processed in 338us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393265.806074:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787393265.806201:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338494464:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787393265.807445:0:14883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787393265.807604:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338494592:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787393265.807706:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393265.807867:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de834dda6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393265.807990:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338494592 00000100:00100000:1.0:1787393265.807996:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338494592 00000100:00100000:1.0:1787393265.808089:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787393265.808098:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f77c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+14:14883:x1874217338494592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787393265.808409:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f77c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+14:14883:x1874217338494592:12345-0@lo:502:mount.lustre.0 Request processed in 311us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393265.808417:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787393265.808504:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338494592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787393265.808801:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787393265.808886:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787393265.809110:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787393265.809183:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787393265.809234:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787393265.809289:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787393265.809369:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787393265.809443:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787393265.809488:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787393265.809626:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787393265.809688:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787393265.809825:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787393265.809895:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338494720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787393265.810093:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393265.815042:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338494720 00000100:00100000:2.0:1787393265.815055:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338494720 00000100:00100000:2.0:1787393265.815111:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787393265.815120:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de802df3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+14:14883:x1874217338494720:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787393265.815427:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de802df3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+14:14883:x1874217338494720:12345-0@lo:502:mount.lustre.0 Request processed in 306us (5332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393265.815442:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787393265.816033:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de834dda6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787393265.816058:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338494720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787393265.816178:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787393265.816194:0:14883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1787393265.817662:0:14897:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787393265.817672:0:14897:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787393265.817679:0:14897:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393265.817681:0:14897:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787393265.817686:0:14897:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787393265.817701:0:14897:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9de81808cd40) 00000020:00000080:1.0:1787393265.817791:0:14897:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787393265.817799:0:14897:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787393265.817889:0:14897:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9de827af4800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787393265.817897:0:14897:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787393265.817990:0:14897:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x19a927d9c62f24c2 00010000:00010000:1.0:1787393265.823291:0:14897:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1787393265.824250:0:14897:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1787393265.827195:0:14897:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787393265.829469:0:14897:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787393265.829481:0:14897:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787393265.829488:0:14897:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393265.829490:0:14897:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787393265.829494:0:14897:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787393265.829497:0:14897:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787393265.829499:0:14897:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787393265.829500:0:14897:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787393265.829502:0:14897:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787393265.829504:0:14897:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393265.829506:0:14897:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787393265.829508:0:14897:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787393265.829511:0:14897:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393265.829512:0:14897:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787393265.829515:0:14897:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787393265.829517:0:14897:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787393265.829519:0:14897:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787393265.829521:0:14897:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393265.829522:0:14897:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787393265.829592:0:14897:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787393265.829596:0:14897:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393265.829597:0:14897:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787393265.829600:0:14897:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787393265.829661:0:14897:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787393265.829664:0:14897:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393265.829666:0:14897:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787393265.829669:0:14897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787393265.830018:0:14883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787393265.830048:0:14883:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787393265.830070:0:14883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80761c200/0x19a927d9c62f24ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f24b4 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393265.830092:0:14883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de80761c200/0x19a927d9c62f24ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f24b4 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393265.830101:0:14883:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de827af4800 from 1 10000000:01000000:2.0:1787393265.830115:0:14883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787393265.830151:0:14883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8186b4800/0x19a927d9c62f24c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393265.830159:0:14883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8186b4800/0x19a927d9c62f24c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393265.830170:0:14883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8186b4800/0x19a927d9c62f24c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393265.830194:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338494848:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787393265.830255:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393265.830298:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb38480 going to sleep for 11 seconds 00000100:00100000:0.0:1787393265.830699:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338494848 00000100:00100000:0.0:1787393265.830713:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338494848 00000100:00100000:0.0:1787393265.830831:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787393265.830878:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de802df2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+14:14883:x1874217338494848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787393265.830892:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393265.831036:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80761d400/0x19a927d9c62f24d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f24c9 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393265.831061:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761d400/0x19a927d9c62f24d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f24c9 expref: 15 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393265.831071:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80761d400/0x19a927d9c62f24d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f24c9 expref: 15 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393265.831080:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80761d400, rc 0) 00000100:00100000:0.0:1787393265.831133:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de802df2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+15:14883:x1874217338494848:12345-0@lo:101:mount.lustre.0 Request processed in 294us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393265.831139:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787393265.831219:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338494848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787393265.831234:0:14883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8186b4800/0x19a927d9c62f24c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f24d0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393265.831243:0:14883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8186b4800/0x19a927d9c62f24c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f24d0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787393265.832145:0:14883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787393265.834700:0:14883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787393265.836145:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787393265.836192:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787393265.836242:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787393265.836251:0:14883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787393265.837443:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338494976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787393265.837510:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393265.837665:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb38480 going to sleep for 11 seconds 00000100:00100000:0.0:1787393265.841080:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338494976 00000100:00100000:0.0:1787393265.841096:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338494976 00000100:00100000:0.0:1787393265.841241:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787393265.841251:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+15:14883:x1874217338494976:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787393265.842077:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+15:14883:x1874217338494976:12345-0@lo:501:mount.lustre.0 Request processed in 824us (4563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393265.842087:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787393265.842359:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338494976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787393265.842426:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338495104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787393265.842472:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393265.842510:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80614d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787393265.842614:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338495104 00000100:00100000:0.0:1787393265.842620:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338495104 00000100:00100000:0.0:1787393265.842656:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787393265.842663:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e87b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+15:14883:x1874217338495104:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787393265.842867:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e87b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+15:14883:x1874217338495104:12345-0@lo:503:mount.lustre.0 Request processed in 204us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393265.842874:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787393265.843123:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338495104:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787393265.844080:0:14883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787393265.844153:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338495232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787393265.844210:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393265.845102:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8055b7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787393265.846458:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338495232 00000100:00100000:0.0:1787393265.846470:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338495232 00000100:00100000:0.0:1787393265.847333:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787393265.847345:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e87bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+15:14883:x1874217338495232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787393265.848159:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e87bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+15:14883:x1874217338495232:12345-0@lo:502:mount.lustre.0 Request processed in 814us (3945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393265.848428:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787393265.848618:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338495232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787393265.849138:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787393265.849202:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787393265.849268:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787393265.849325:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787393265.849362:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787393265.849439:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787393265.849477:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787393265.849507:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787393265.849616:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338495360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787393265.849676:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393265.851167:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83cb389c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393265.851256:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338495360 00000100:00100000:1.0:1787393265.851264:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338495360 00000100:00100000:1.0:1787393265.851377:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787393265.851388:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+15:14883:x1874217338495360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787393265.851751:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+15:14883:x1874217338495360:12345-0@lo:502:mount.lustre.0 Request processed in 365us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393265.851768:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787393265.859467:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338495360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787393265.859822:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787393265.859991:0:14883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787393265.865256:0:14901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787393265.865271:0:14901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393265.865274:0:14901:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787393265.865281:0:14901:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9de827af4800 00000020:00000080:3.0:1787393265.865285:0:14901:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787393265.865292:0:14901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787393265.865294:0:14901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393265.865296:0:14901:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787393265.865298:0:14901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787393265.865382:0:14901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393265.865384:0:14901:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787393265.865389:0:14901:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9de827af4800 00000020:00000080:3.0:1787393265.865391:0:14901:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787393265.865498:0:14901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787393265.865502:0:14901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393265.865503:0:14901:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787393265.865506:0:14901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787393265.865508:0:14901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393265.865509:0:14901:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787393265.865513:0:14901:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9de827af4800 00000020:00000080:3.0:1787393265.865515:0:14901:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787393265.867473:0:14901:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787393265.867482:0:14901:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787393265.867484:0:14901:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787393265.867488:0:14901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787393265.880025:0:14883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787393265.880071:0:14883:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787393265.880094:0:14883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8186b4800/0x19a927d9c62f24c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f24d0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393265.880107:0:14883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8186b4800/0x19a927d9c62f24c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f24d0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393265.880407:0:14883:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787393265.880411:0:14883:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9de827af4800 10000000:01000000:1.0:1787393265.880414:0:14883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9de827af4800 10000000:01000000:1.0:1787393265.880418:0:14883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787393265.880424:0:14883:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9de827af4800 from 1 10000000:01000000:1.0:1787393265.880426:0:14883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787393265.880460:0:14883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80385a000/0x19a927d9c62f24d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393265.880469:0:14883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de80385a000/0x19a927d9c62f24d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393265.880479:0:14883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de80385a000/0x19a927d9c62f24d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393265.880500:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338495488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787393265.881452:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393265.881498:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818157600 going to sleep for 11 seconds 00000100:00100000:2.0:1787393265.882050:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338495488 00000100:00100000:2.0:1787393265.882058:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338495488 00000100:00100000:2.0:1787393265.882105:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787393265.882114:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e87ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+15:14883:x1874217338495488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787393265.882129:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393265.882144:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8186b5c00/0x19a927d9c62f24de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f24d7 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393265.882182:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8186b5c00/0x19a927d9c62f24de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f24d7 expref: 16 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393265.882192:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8186b5c00/0x19a927d9c62f24de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f24d7 expref: 16 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393265.882200:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5c00, rc 0) 00000100:00100000:2.0:1787393265.882244:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e87ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:14883:x1874217338495488:12345-0@lo:101:mount.lustre.0 Request processed in 131us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393265.882251:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787393265.887637:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338495488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787393265.887664:0:14883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de80385a000/0x19a927d9c62f24d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f24de expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393265.887677:0:14883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de80385a000/0x19a927d9c62f24d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f24de expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787393265.890459:0:14883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787393265.893129:0:14883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787393265.895071:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787393265.895153:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787393265.895189:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787393265.895238:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787393265.895274:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787393265.895338:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787393265.895406:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787393265.895444:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787393265.895509:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787393265.899930:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787393265.899981:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787393265.900048:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787393265.900080:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787393265.900107:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787393265.900164:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787393265.900198:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787393265.900249:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787393265.900298:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787393265.902957:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787393265.902997:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787393265.903077:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787393265.903115:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787393265.903150:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787393265.903199:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787393265.903231:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787393265.903259:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787393265.903301:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787393265.903332:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787393265.903430:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787393265.903438:0:14883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787393265.906911:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338495616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787393265.906981:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393265.907018:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818157780 going to sleep for 11 seconds 00000100:00100000:2.0:1787393265.907095:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338495616 00000100:00100000:2.0:1787393265.907102:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338495616 00000100:00100000:2.0:1787393265.907152:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787393265.907162:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e87a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:14883:x1874217338495616:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787393265.907440:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e87a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:14883:x1874217338495616:12345-0@lo:501:mount.lustre.0 Request processed in 279us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393265.907448:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787393265.907944:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338495616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787393265.907983:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338495744:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787393265.908030:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393265.908059:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818157780 going to sleep for 11 seconds 00000100:00100000:0.0:1787393265.908629:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338495744 00000100:00100000:0.0:1787393265.908636:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338495744 00000100:00100000:0.0:1787393265.908680:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787393265.908689:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e87a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:14883:x1874217338495744:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787393265.911061:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e87a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:14883:x1874217338495744:12345-0@lo:503:mount.lustre.0 Request processed in 2365us (3023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393265.911074:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787393265.913767:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338495744:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787393265.914341:0:14883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787393265.914443:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338495872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787393265.914511:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393265.914558:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818104480 going to sleep for 11 seconds 00000100:00100000:2.0:1787393265.914874:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338495872 00000100:00100000:2.0:1787393265.914881:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338495872 00000100:00100000:2.0:1787393265.914925:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787393265.914933:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:14883:x1874217338495872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787393265.915139:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:14883:x1874217338495872:12345-0@lo:502:mount.lustre.0 Request processed in 206us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393265.915147:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787393265.917910:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338495872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787393265.918226:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787393265.918288:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787393265.918320:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787393265.918364:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787393265.918414:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787393265.918463:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787393265.918500:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787393265.918538:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787393265.918617:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787393265.918658:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787393265.918697:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787393265.918760:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787393265.918809:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787393265.918895:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787393265.918957:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787393265.919049:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787393265.919084:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787393265.919136:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787393265.919172:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787393265.919204:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787393265.919248:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787393265.919282:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787393265.919319:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787393265.919367:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787393265.919434:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787393265.919471:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787393265.919521:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787393265.919557:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787393265.919589:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787393265.919634:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787393265.919670:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787393265.919700:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787393265.919733:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787393265.919780:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787393265.919815:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787393265.919889:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787393265.919926:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787393265.919959:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787393265.920023:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787393265.920061:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787393265.920108:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338496000:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787393265.920184:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393265.920222:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818104480 going to sleep for 11 seconds 00000100:00100000:2.0:1787393265.920545:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338496000 00000100:00100000:2.0:1787393265.920554:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338496000 00000100:00100000:2.0:1787393265.920615:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787393265.920625:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e87b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:14883:x1874217338496000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787393265.920920:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e87b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:14883:x1874217338496000:12345-0@lo:502:mount.lustre.0 Request processed in 296us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393265.920930:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787393265.927799:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338496000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787393265.928262:0:14883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787393265.928279:0:14883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787393265.933921:0:14906:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787393265.933938:0:14906:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9de834ed3380) 00000020:00000080:3.0:1787393265.933957:0:14906:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787393265.935707:0:14906:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9de827af4800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787393265.935715:0:14906:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9de827af4800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787393265.936169:0:14906:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9de827af4800 3 00010000:00080000:2.0:1787393265.936209:0:14906:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9de81ea72000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.121@tcp at head 00010000:00010000:2.0:1787393265.938597:0:14906:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787393265.938703:0:14906:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787393265.938820:0:14906:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787393265.938834:0:14906:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x19a927d9c62f24ec 00000100:00080000:2.0:1787393265.939233:0:14906:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787393265.939240:0:14906:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9de81ea72000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:2.0:1787393265.939273:0:14906:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de83c5a5180 x1874217338496128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787393265.939406:0:14906:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787393265.939612:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787393265.939617:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787393265.939620:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787393265.939623:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787393265.939677:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338496256:0@lo:400:kworker.0 00000100:00100000:1.0:1787393265.939755:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393265.939815:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338496256 00000100:00100000:1.0:1787393265.939821:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338496256 00000100:00100000:1.0:1787393265.939885:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787393265.939893:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338496256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393265.939962:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1874217338496256:12345-0@lo:400:kworker.0 Request processed in 56us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393265.939969:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787393265.940006:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9de83532a680 x1874217338496256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393265.940019:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1874217338496256:0@lo:400:kworker.0 00000100:00100000:3.0:1787393265.943452:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3323:1874217338496128:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787393265.943521:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1787393265.944898:0:14906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787393265.945266:0:14883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787393265.945293:0:14883:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787393265.945834:0:14883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80385a000/0x19a927d9c62f24d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f24de expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393265.945879:0:14883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de80385a000/0x19a927d9c62f24d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f24de expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787393265.945929:0:14883:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787393265.945932:0:14883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787393265.945933:0:14883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787393265.945934:0:14883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787393265.945935:0:14883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787393265.945937:0:14883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787393265.945938:0:14883:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787393265.945940:0:14883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787393265.945942:0:14883:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787393265.945946:0:14883:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787393265.945949:0:14883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787393265.945950:0:14883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787393265.945952:0:14883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787393265.945953:0:14883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787393265.945954:0:14883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787393265.945955:0:14883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787393265.945956:0:14883:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787393265.945957:0:14883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787393265.945957:0:14883:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787393265.945980:0:14883:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787393265.945998:0:14883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338496384:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787393265.946054:0:14883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393265.946092:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338496384 00000100:00100000:0.0:1787393265.946098:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338496384 00000100:00100000:0.0:1787393265.946138:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787393265.946146:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:14883:x1874217338496384:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787393265.946190:0:14243:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787393265.946203:0:14243:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787393265.946896:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338496128 00000100:00100000:2.0:1787393265.946903:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338496128 00000100:00100000:2.0:1787393265.946932:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787393265.946938:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3323:x1874217338496128:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787393265.946959:0:14249:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:2.0:1787393265.946993:0:14249:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x19a927d9c62f24f3 00000004:00100000:2.0:1787393265.947007:0:14249:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787393265.947036:0:14249:0:(import.c:65:import_set_state_nolock()) ffff9de81ea76800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787393265.947099:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1874217338496128:12345-0@lo:38:llog_process_th.0 Request processed in 160us (3577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393265.947115:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787393265.947167:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9de83c5a5180 x1874217338496128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787393275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393265.947178:0:3323:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787393265.947185:0:3323:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787393265.947192:0:3323:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787393265.947196:0:3323:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787393265.947198:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de81ea72000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787393265.947204:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3323:1874217338496128:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787393265.954432:0:14883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818104480 going to sleep for 11 seconds 20000000:01000000:3.0:1787393266.005366:0:14243:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787393266.005386:0:14243:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787393266.005425:0:14265:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787393266.005431:0:14265:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787393266.005453:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9de80761d200/0x19a927d9c62f24fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393266.005473:0:14265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de80385b200/0x19a927d9c62f2467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f2460 expref: 16 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393266.005481:0:14265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9de80761d200/0x19a927d9c62f24fa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393266.005516:0:14265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de80385b200/0x19a927d9c62f2467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f2460 expref: 16 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393266.005529:0:14265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de80385b200/0x19a927d9c62f2467 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f2460 expref: 16 pid: 14244 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393266.005542:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835255180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14265:1874217338496512:0@lo:104: 00000100:00100000:0.0:1787393266.005598:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393266.005651:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338496512 00000100:00100000:0.0:1787393266.005657:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8181046c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393266.005660:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338496512 00000100:00100000:1.0:1787393266.005714:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787393266.005725:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835256300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+3:14265:x1874217338496512:12345-0@lo:104: 00010000:00010000:1.0:1787393266.005737:0:14232:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f2460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f2467 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393266.005863:0:14232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787393266.005870:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835256300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+3:14265:x1874217338496512:12345-0@lo:104: Request processed in 147us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393266.005877:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787393266.005903:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787393266.005908:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f2460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f2467 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393266.005916:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385b800 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1787393266.005920:0:14237:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f2460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f2467 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393266.005929:0:14237:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f2460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f2467 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393266.005954:0:14237:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f2460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f2467 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393266.005960:0:14237:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787393266.005999:0:14237:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f2460 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2467 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393266.006006:0:14237:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787393266.006036:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f2460 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2467 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393266.006043:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f2460 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2467 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393266.006052:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1787393266.006059:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393266.006063:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393266.006065:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393266.006066:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3327:1874217338496640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787393266.006098:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393266.006156:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338496640 00000100:00100000:1.0:1787393266.006162:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338496640 00010000:00010000:1.0:1787393266.006184:0:14236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de80385b200/0x19a927d9c62f2467 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f2460 expref: 17 pid: 14244 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393266.006213:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787393266.006221:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:3327:x1874217338496640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787393266.006233:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393266.006238:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de80385b200/0x19a927d9c62f2467 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f2460 expref: 17 pid: 14244 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393266.006250:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de80385b200/0x19a927d9c62f2467 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f2460 expref: 17 pid: 14244 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393266.006276:0:14236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9de80761d200/0x19a927d9c62f24fa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393266.006284:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80761d200/0x19a927d9c62f24fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787393266.006297:0:14236:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007543549s 00010000:00010000:1.0:1787393266.006301:0:14236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de80761d200/0x19a927d9c62f24fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393266.006308:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de80761d200/0x19a927d9c62f24fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393266.006315:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9de80761d200/0x19a927d9c62f24fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393266.006322:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9de80761d200/0x19a927d9c62f24fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393266.006327:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761d200 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:1.0:1787393266.006331:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9de80761d200/0x19a927d9c62f24fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393266.006338:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9de80761d200/0x19a927d9c62f24fa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393266.006347:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9de80761d200/0x19a927d9c62f24fa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393266.006356:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393266.006420:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:3327:x1874217338496640:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393266.006435:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787393266.006568:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3327:1874217338496640:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787393266.007142:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80385b200/0x19a927d9c62f2467 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f2460 expref: 16 pid: 14244 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393266.007155:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835255180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14265:1874217338496512:0@lo:104: 00010000:00010000:3.0:1787393266.007170:0:14265:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9de80761d200/0x19a927d9c62f24fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393266.007180:0:14265:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9de80761d200/0x19a927d9c62f24fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393266.007193:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9de80761d200/0x19a927d9c62f24fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393266.007200:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80761d200/0x19a927d9c62f24fa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393266.070168:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+15:14883:x1874217338496384:12345-0@lo:253:mount.lustre.0 Request processed in 124009us (124100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393266.070184:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787393266.070249:0:14883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14883:1874217338496384:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787393266.070265:0:14883:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787393266.070268:0:14883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787393266.070277:0:14883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787393266.070278:0:14883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787393266.070280:0:14883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787393266.070281:0:14883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787393266.070282:0:14883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787393266.070284:0:14883:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787393266.070285:0:14883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787393266.070287:0:14883:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787393266.070303:0:14883:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787393266.082041:0:14883:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787393266.082191:0:14883:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787393266.082449:0:14883:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787393266.082596:0:14883:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787393266.083077:0:14883:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787393266.083238:0:14883:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787393266.092961:0:14883:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787393266.149492:0:14883:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787393266.149500:0:14883:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787393266.149540:0:14883:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787393266.149602:0:14883:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.121@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787393266.149626:0:14883:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787393266.149660:0:14883:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787393266.346017:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787393267.120178:0:14246:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787393267.120186:0:14246:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9de83f587000 from 7 10000000:01000000:0.0:1787393267.120191:0:14246:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787393267.120237:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f2501 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393267.120251:0:14246:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f2501 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393267.120263:0:14246:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f2501 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393267.120291:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338496768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787393267.120357:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393267.120429:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8181046c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393267.120531:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338496768 00000100:00100000:1.0:1787393267.120539:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338496768 00000100:00100000:1.0:1787393267.120594:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787393267.120603:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+15:14246:x1874217338496768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787393267.120615:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393267.120628:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80385a600/0x19a927d9c62f2508 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f2501 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393267.120649:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80385a600/0x19a927d9c62f2508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f2501 expref: 16 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393267.120659:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80385a600/0x19a927d9c62f2508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f2501 expref: 16 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393267.120668:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385a600, rc 0) 00000100:00100000:1.0:1787393267.120706:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:14246:x1874217338496768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393267.120713:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787393267.121018:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338496768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787393267.121032:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f2501 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2508 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393267.121040:0:14246:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f2501 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f2508 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393267.121095:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338496896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787393267.121137:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393267.121165:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8181046c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393267.121258:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338496896 00000100:00100000:1.0:1787393267.121270:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338496896 00000100:00100000:1.0:1787393267.121305:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787393267.121312:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:14246:x1874217338496896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787393267.121327:0:14243:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787393267.121344:0:14243:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787393267.121347:0:14243:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787393267.121459:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:14246:x1874217338496896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 147us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393267.121467:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787393267.121737:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338496896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787393267.121794:0:14246:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787393267.121801:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f2501 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2508 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393267.121811:0:14246:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f2501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2508 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393267.372862:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393268.395725:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393269.416574:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393270.440413:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787393271.146611:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787393271.146618:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787393271.146621:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787393271.146624:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787393271.146663:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787393271.146683:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3326:1874217338497024:0@lo:400:kworker.0 00000100:00100000:1.0:1787393271.146752:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393271.146810:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338497152:0@lo:400:kworker.0 00000100:00100000:1.0:1787393271.146854:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393271.146874:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787393271.146880:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338497280:0@lo:400:kworker.0 00000100:00100000:1.0:1787393271.146904:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393271.146933:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338497024 00000100:00100000:1.0:1787393271.146952:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338497024 00000100:00100000:1.0:1787393271.146996:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787393271.147004:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e87a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:3326:x1874217338497024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393271.147053:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e87a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:3326:x1874217338497024:12345-0@lo:400:kworker.0 Request processed in 49us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393271.147061:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787393271.147092:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338497152 00000100:00100000:1.0:1787393271.147096:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338497152 00000100:00100000:1.0:1787393271.147116:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338497280 00000100:00100000:1.0:1787393271.147118:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338497280 00000100:00100000:1.0:1787393271.147140:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787393271.147146:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338497152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393271.147180:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338497152:12345-0@lo:400:kworker.0 Request processed in 33us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393271.147187:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787393271.147198:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787393271.147204:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338497280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393271.147224:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338497280:12345-0@lo:400:kworker.0 Request processed in 21us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393271.147229:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787393271.147263:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787393271.147289:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de83532aa00 x1874217338497280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393271.147302:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338497280:0@lo:400:kworker.0 00010000:00080000:1.0:1787393271.147313:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de835329880 x1874217338497152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393271.147335:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338497152:0@lo:400:kworker.0 00000100:00100000:1.0:1787393271.147374:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3326:1874217338497024:0@lo:400:kworker.0 00010000:00010000:1.0:1787393271.466641:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787393272.040407:0:14283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787393272.488042:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787393273.179071:0:15250:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787393273.517023:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393274.544674:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393275.177832:0:3323:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787393260/real 1787393260] req@ffff9de83c5a6a00 x1874217338493312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787393275 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393275.177913:0:3323:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9de83c5a6a00 x1874217338493312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787393275 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393275.177925:0:3323:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787393260/real 1787393260] req@ffff9de83c5a7800 x1874217338493056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787393275 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393275.177943:0:3323:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9de83c5a7800 x1874217338493056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787393275 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787393275.177969:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de83b440000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787393275.179289:0:3323:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787393275.179299:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338493312:0@lo:8:kworker.0 00000100:00080000:1.0:1787393275.179311:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de80929d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787393275.182946:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787393275.182956:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787393275.182960:0:37:0:(import.c:65:import_set_state_nolock()) ffff9de83b440000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787393275.182971:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 410 00000100:00080000:0.0:1787393275.182979:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787393275.183105:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9de83b440000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:0.0:1787393275.183134:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de835255500 x1874217338497536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787393275.183148:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787393275.183152:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787393275.183154:0:37:0:(import.c:65:import_set_state_nolock()) ffff9de80929d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787393275.183157:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 410 00000100:00080000:0.0:1787393275.183160:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787393275.183164:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9de80929d800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:0.0:1787393275.183174:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de835255880 x1874217338497664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787393275.183245:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3326:1874217338497408:0@lo:400:kworker.0 00000100:00100000:0.0:1787393275.183346:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393275.183429:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787393275.183436:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874217338497792:0@lo:400:kworker.0 00000100:00100000:0.0:1787393275.183482:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393275.183521:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338497920:0@lo:400:kworker.0 00000100:00100000:0.0:1787393275.183566:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393275.183611:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338497408 00000100:00100000:0.0:1787393275.183621:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338497408 00000100:00100000:0.0:1787393275.183695:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787393275.183706:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:3326:x1874217338497408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393275.183762:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:3326:x1874217338497408:12345-0@lo:400:kworker.0 Request processed in 57us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393275.183770:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787393275.183814:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338497792 00000100:00100000:0.0:1787393275.183818:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338497792 00000100:00100000:0.0:1787393275.183872:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338497920 00000100:00100000:0.0:1787393275.183876:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338497920 00000100:00100000:0.0:1787393275.184349:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787393275.184398:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1874217338497792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393275.184445:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1874217338497792:12345-0@lo:400:kworker.0 Request processed in 90us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393275.184452:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787393275.184466:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787393275.184471:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338497920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393275.184501:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338497920:12345-0@lo:400:kworker.0 Request processed in 30us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393275.184507:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787393275.184534:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787393275.184568:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de835254380 x1874217338497920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393275.184584:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338497920:0@lo:400:kworker.0 00010000:00080000:0.0:1787393275.184677:0:3326:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de835254a80 x1874217338497792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787393275.184687:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874217338497792:0@lo:400:kworker.0 00000100:00100000:0.0:1787393275.184698:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3326:1874217338497408:0@lo:400:kworker.0 00000100:00080000:1.0:1787393275.185171:0:3323:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787393275.185178:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338493056:0@lo:8:kworker.0 00000100:00100000:1.0:1787393275.185237:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338497536:0@lo:8:kworker.0 00000100:00100000:1.0:1787393275.185295:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393275.185363:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338497664:0@lo:8:kworker.0 00000100:00100000:3.0:1787393275.185374:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338497536 00000100:00100000:3.0:1787393275.185381:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338497536 00000100:00100000:1.0:1787393275.185387:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393275.187939:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338497664 00000100:00100000:3.0:1787393275.187959:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338497664 00000100:00100000:3.0:1787393275.188012:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787393275.188022:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3323:x1874217338497536:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787393275.188061:0:14884:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:3.0:1787393275.188107:0:14884:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a927d9c62f250f 00002000:00100000:3.0:1787393275.188137:0:14884:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9de83facf800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787393275.188142:0:14884:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787393275.188145:0:14884:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787393275.188699:0:14884:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787393275.188751:0:14884:0:(import.c:65:import_set_state_nolock()) ffff9de83face000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787393275.188902:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3323:x1874217338497536:12345-0@lo:8:kworker.0 Request processed in 879us (3604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393275.188912:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787393275.188928:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de835255500 x1874217338497536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787393295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787393275.188937:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787393275.188943:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3323:x1874217338497664:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787393275.188943:0:3323:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787393275.188953:0:3323:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00010000:00020000:3.0:1787393275.188956:0:14884:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1787393275.188963:0:3323:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787393275.188970:0:3323:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787393275.188973:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de83b440000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787393275.188984:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3323:x1874217338497664:12345-0@lo:8:kworker.0 Request processed in 41us (3595us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787393275.188990:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:1.0:1787393275.189005:0:3323:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787393275.189012:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338497536:0@lo:8:kworker.0 00000100:00080000:1.0:1787393275.189027:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de80929d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787393275.189032:0:3323:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787393275.189035:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338497664:0@lo:8:kworker.0 00000004:00080000:1.0:1787393275.189128:0:14272:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1787393275.189154:0:14272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14272:1874217338498176:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787393275.189194:0:14272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393275.189215:0:14272:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8351c2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787393275.189591:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338498048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787393275.189626:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393275.189759:0:14888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338498048 00000100:00100000:1.0:1787393275.189766:0:14888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338498048 00000100:00100000:1.0:1787393275.189820:0:14888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787393275.189828:0:14888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3325:x1874217338498048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787393275.189887:0:14888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393275.189929:0:14888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3325:x1874217338498048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393275.189945:0:14888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787393275.189979:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de83532aa00 x1874217338498048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393275.190007:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338498048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787393275.190363:0:14886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338498176 00000100:00100000:0.0:1787393275.190369:0:14886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338498176 00000100:00100000:0.0:1787393275.190402:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787393275.190411:0:14886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14272:x1874217338498176:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1787393275.191640:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1787393275.199746:0:14886:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787393275.199763:0:14886:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787393275.199771:0:14886:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000004:00080000:1.0:1787393275.201128:0:14271:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787393275.201509:0:14271:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424376667853ns, next at 0ns, rc = 0 00002000:00010000:0.0:1787393275.226747:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.226766:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f2516 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.226789:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.226794:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.226802:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f2516 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.226822:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f2516 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.226833:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f2516 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.226870:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f2516 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.226900:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787393275.226921:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393275.226927:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f2516 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.226936:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761cc00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393275.226941:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f2516 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.226952:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f2516 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.226971:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f2516 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.226979:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f2516 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.226998:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.227000:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.227002:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787393275.227674:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.227690:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f251d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.227700:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.227704:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.227709:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f251d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.227720:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f251d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.227728:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f251d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.227734:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f251d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.227754:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787393275.227766:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393275.227771:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f251d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.227779:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761dc00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393275.227783:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f251d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.227791:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f251d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.227812:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f251d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.227819:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f251d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.227834:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.227860:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.227862:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787393275.228300:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.228307:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f2524 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.228315:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.228318:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.228322:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f2524 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.228342:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f2524 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.228351:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f2524 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.228359:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f2524 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.228388:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787393275.228398:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393275.228403:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f2524 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.228411:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761d600 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393275.228415:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f2524 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.228423:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f2524 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.228435:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f2524 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.228443:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f2524 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.228456:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.228457:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.228459:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787393275.228994:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.229002:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f252b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.229012:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.229023:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.229027:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f252b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.229037:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f252b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.229046:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f252b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.229053:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f252b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.229069:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787393275.229079:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393275.229083:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f252b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.229091:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761c800 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393275.229095:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f252b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.229103:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f252b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.229114:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f252b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.229133:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f252b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.229148:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.229150:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.229151:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787393275.229618:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.229625:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f2532 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.229634:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.229638:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.229642:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f2532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.229651:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f2532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.229659:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f2532 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.229668:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f2532 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.229696:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787393275.230130:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.230142:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2539 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.230151:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.230154:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.230159:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2539 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.230168:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2539 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.230177:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2539 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.230185:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2539 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.230199:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787393275.230209:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787393275.230213:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f2532 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.230221:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761ca00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393275.230225:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f2532 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.230234:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f2532 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.230256:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f2532 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.230264:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f2532 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.230280:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393275.230284:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2539 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.230291:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761c400 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393275.230295:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2539 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.230303:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2539 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.230314:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2539 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.230321:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2539 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.231216:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.233851:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.233861:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.233872:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787393275.235229:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.235245:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f69c4bdc/0x19a927d9c62f2540 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.235265:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.235271:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.235279:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f69c4bdc/0x19a927d9c62f2540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.235864:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f69c4bdc/0x19a927d9c62f2540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.235880:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f69c4bdc/0x19a927d9c62f2540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.235890:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f69c4bdc/0x19a927d9c62f2540 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.235918:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787393275.235936:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393275.235943:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f69c4bdc/0x19a927d9c62f2540 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.235952:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761d000 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393275.235957:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f69c4bdc/0x19a927d9c62f2540 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.235982:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f69c4bdc/0x19a927d9c62f2540 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.236003:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f69c4bdc/0x19a927d9c62f2540 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.236010:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f69c4bdc/0x19a927d9c62f2540 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.236032:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.236035:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.236036:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787393275.240684:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.240701:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2547 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.240722:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.240727:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.240734:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2547 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.240751:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2547 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.240763:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2547 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.240778:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2547 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.240801:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787393275.240816:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393275.240823:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2547 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.240831:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761c400 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393275.240837:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2547 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.241071:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2547 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.241092:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2547 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.241099:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f28b96e/0x19a927d9c62f2547 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.241117:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.241119:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.241121:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787393275.242910:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.242934:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f254e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.242951:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.242956:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.242962:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f254e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.242977:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f254e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.242987:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f254e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.242996:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f254e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.243014:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787393275.243031:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393275.243037:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f254e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.243045:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761ca00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393275.243051:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f254e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.243061:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f254e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.243084:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f254e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.243093:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065ce5db2/0x19a927d9c62f254e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.243112:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.243115:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.243117:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787393275.245120:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.245136:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2555 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.245155:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.245159:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.245166:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2555 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.245180:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2555 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.245190:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2555 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.245199:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2555 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.245235:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787393275.245252:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393275.245258:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2555 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.245267:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761c800 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393275.245273:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2555 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.245284:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2555 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.245759:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2555 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.245768:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c77ce5e7/0x19a927d9c62f2555 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.245791:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.245793:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393275.245795:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787393275.246494:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.246503:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f255c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.246513:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.246524:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.246530:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f255c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.246542:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f255c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.246635:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f255c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.246644:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f255c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.246672:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787393275.246991:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787393275.247001:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f255c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.247013:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761d600 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393275.247024:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f255c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.247035:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f255c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.247056:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f255c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.247063:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a227d40/0x19a927d9c62f255c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.247087:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393275.247090:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393275.247092:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787393275.247210:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.247216:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f2563 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.247226:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.247230:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.247234:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f2563 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.247244:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f2563 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.247253:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f2563 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.247269:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f2563 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.247294:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787393275.247358:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393275.247366:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f2563 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.247374:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761dc00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393275.247379:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f2563 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.247387:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f2563 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.247404:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f2563 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.247436:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1ac93dd/0x19a927d9c62f2563 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.247457:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393275.247460:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393275.247461:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787393275.248221:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.248230:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f256a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.248242:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.248246:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.248251:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f256a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.248263:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f256a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.248273:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f256a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.248280:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f256a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.248430:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787393275.248599:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393275.248606:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f256a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.248615:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761cc00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393275.248620:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f256a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.248631:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f256a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.248646:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f256a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.248654:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020bc067e/0x19a927d9c62f256a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.248674:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393275.248677:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393275.248678:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787393275.253646:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.253663:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061fd0679/0x19a927d9c62f2571 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.253695:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.253700:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.253707:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061fd0679/0x19a927d9c62f2571 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.253726:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061fd0679/0x19a927d9c62f2571 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.253737:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061fd0679/0x19a927d9c62f2571 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.253746:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061fd0679/0x19a927d9c62f2571 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.253778:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787393275.253887:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787393275.253897:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061fd0679/0x19a927d9c62f2571 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.253909:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761d200 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393275.253915:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061fd0679/0x19a927d9c62f2571 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.253927:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061fd0679/0x19a927d9c62f2571 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.253949:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061fd0679/0x19a927d9c62f2571 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.253966:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061fd0679/0x19a927d9c62f2571 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.253994:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393275.253996:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393275.253998:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787393275.267061:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.267083:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1543f08/0x19a927d9c62f2578 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.267106:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.267112:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.267120:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1543f08/0x19a927d9c62f2578 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.267593:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1543f08/0x19a927d9c62f2578 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.267623:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1543f08/0x19a927d9c62f2578 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.267633:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1543f08/0x19a927d9c62f2578 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.267660:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787393275.268305:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787393275.268317:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1543f08/0x19a927d9c62f2578 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.268338:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbf800 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393275.268345:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1543f08/0x19a927d9c62f2578 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.268356:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1543f08/0x19a927d9c62f2578 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.268378:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1543f08/0x19a927d9c62f2578 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.268386:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1543f08/0x19a927d9c62f2578 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.268409:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393275.268410:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393275.268412:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787393275.268806:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.268815:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de34e458/0x19a927d9c62f257f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.268827:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.268832:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.268861:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de34e458/0x19a927d9c62f257f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.268873:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de34e458/0x19a927d9c62f257f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.268881:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de34e458/0x19a927d9c62f257f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.268964:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de34e458/0x19a927d9c62f257f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.268997:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787393275.269864:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.269873:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfaa5625/0x19a927d9c62f2586 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.269885:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.269961:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.269968:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfaa5625/0x19a927d9c62f2586 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.269980:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfaa5625/0x19a927d9c62f2586 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.269988:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfaa5625/0x19a927d9c62f2586 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.269995:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfaa5625/0x19a927d9c62f2586 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.270007:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787393275.270759:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.270768:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ea15469/0x19a927d9c62f258d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.270778:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.270788:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.270793:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ea15469/0x19a927d9c62f258d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.270805:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ea15469/0x19a927d9c62f258d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.270814:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ea15469/0x19a927d9c62f258d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.270823:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ea15469/0x19a927d9c62f258d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.270832:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787393275.270900:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787393275.270908:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de34e458/0x19a927d9c62f257f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.270919:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbf200 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393275.270925:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de34e458/0x19a927d9c62f257f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.270936:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de34e458/0x19a927d9c62f257f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.270956:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de34e458/0x19a927d9c62f257f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.270964:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de34e458/0x19a927d9c62f257f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.270989:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787393275.270994:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfaa5625/0x19a927d9c62f2586 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.270999:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbe800 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393275.271002:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfaa5625/0x19a927d9c62f2586 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.271010:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfaa5625/0x19a927d9c62f2586 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.271033:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfaa5625/0x19a927d9c62f2586 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.271043:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfaa5625/0x19a927d9c62f2586 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.271060:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787393275.271063:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ea15469/0x19a927d9c62f258d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.271069:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbec00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393275.271073:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ea15469/0x19a927d9c62f258d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.271081:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ea15469/0x19a927d9c62f258d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.271092:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ea15469/0x19a927d9c62f258d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.271099:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ea15469/0x19a927d9c62f258d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.271113:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393275.271116:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393275.271123:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787393275.271692:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.271701:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa086775/0x19a927d9c62f2594 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.271711:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.271714:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.271720:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa086775/0x19a927d9c62f2594 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.271731:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa086775/0x19a927d9c62f2594 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.271741:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa086775/0x19a927d9c62f2594 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.271756:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa086775/0x19a927d9c62f2594 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.271775:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787393275.272797:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.272808:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd786d8/0x19a927d9c62f259b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.272820:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.272825:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.272829:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cd786d8/0x19a927d9c62f259b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.272862:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cd786d8/0x19a927d9c62f259b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.272872:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd786d8/0x19a927d9c62f259b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.272879:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cd786d8/0x19a927d9c62f259b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.272956:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787393275.273743:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.273751:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e328213b/0x19a927d9c62f25a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.273766:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.273769:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.273773:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e328213b/0x19a927d9c62f25a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.273784:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e328213b/0x19a927d9c62f25a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.273792:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e328213b/0x19a927d9c62f25a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.273799:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e328213b/0x19a927d9c62f25a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.273809:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787393275.274638:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.274648:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020f2ec73/0x19a927d9c62f25a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.274658:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.274661:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.274665:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020f2ec73/0x19a927d9c62f25a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.274674:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020f2ec73/0x19a927d9c62f25a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.274693:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020f2ec73/0x19a927d9c62f25a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.274699:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020f2ec73/0x19a927d9c62f25a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.274709:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1787393275.276427:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787393275.276443:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa086775/0x19a927d9c62f2594 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.276468:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbe000 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393275.276473:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa086775/0x19a927d9c62f2594 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.276486:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa086775/0x19a927d9c62f2594 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.276509:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa086775/0x19a927d9c62f2594 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393275.276517:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa086775/0x19a927d9c62f2594 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.278879:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787393275.278900:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cd786d8/0x19a927d9c62f259b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.278916:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbea00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393275.278922:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd786d8/0x19a927d9c62f259b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.278935:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd786d8/0x19a927d9c62f259b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.278961:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cd786d8/0x19a927d9c62f259b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.278970:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cd786d8/0x19a927d9c62f259b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.279204:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787393275.279210:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e328213b/0x19a927d9c62f25a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.279218:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbfa00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393275.279222:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e328213b/0x19a927d9c62f25a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.279230:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e328213b/0x19a927d9c62f25a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.279255:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e328213b/0x19a927d9c62f25a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.279262:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e328213b/0x19a927d9c62f25a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.279277:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393275.279281:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020f2ec73/0x19a927d9c62f25a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.279288:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbfc00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393275.279291:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020f2ec73/0x19a927d9c62f25a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.279298:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020f2ec73/0x19a927d9c62f25a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.279307:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020f2ec73/0x19a927d9c62f25a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.279314:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020f2ec73/0x19a927d9c62f25a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.279327:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393275.279340:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393275.279349:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393275.279683:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787393275.284832:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.284894:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db984c4e/0x19a927d9c62f25b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.284912:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.284917:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.284922:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db984c4e/0x19a927d9c62f25b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.284939:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db984c4e/0x19a927d9c62f25b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.284949:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db984c4e/0x19a927d9c62f25b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.284957:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db984c4e/0x19a927d9c62f25b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.285021:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787393275.286623:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.286632:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005117639a/0x19a927d9c62f25b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.286645:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.286648:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.286654:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005117639a/0x19a927d9c62f25b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.286665:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005117639a/0x19a927d9c62f25b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.286674:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005117639a/0x19a927d9c62f25b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.286682:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005117639a/0x19a927d9c62f25b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.286706:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787393275.287193:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.287199:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001531c079/0x19a927d9c62f25be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.287209:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.287218:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.287222:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001531c079/0x19a927d9c62f25be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.287230:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001531c079/0x19a927d9c62f25be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.287238:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001531c079/0x19a927d9c62f25be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.287245:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001531c079/0x19a927d9c62f25be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.287253:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787393275.287687:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.287694:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086ba65a1/0x19a927d9c62f25c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.287702:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.287705:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.287709:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086ba65a1/0x19a927d9c62f25c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.287719:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086ba65a1/0x19a927d9c62f25c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.287726:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086ba65a1/0x19a927d9c62f25c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.287740:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086ba65a1/0x19a927d9c62f25c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.287748:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1787393275.288223:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787393275.288229:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b17d9cc5/0x19a927d9c62f25cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.288238:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1787393275.288241:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393275.288246:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b17d9cc5/0x19a927d9c62f25cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.288256:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b17d9cc5/0x19a927d9c62f25cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.288264:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b17d9cc5/0x19a927d9c62f25cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.288272:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b17d9cc5/0x19a927d9c62f25cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393275.288282:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00080000:0.0:1787393275.289014:0:14886:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1787393275.289126:0:14886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14272:x1874217338498176:12345-0@lo:5:osp-pre-0-0.0 Request processed in 98711us (99926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393275.289148:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787393275.290665:0:14272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14272:1874217338498176:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787393275.290695:0:14272:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1787393275.290768:0:14272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14272:1874217338498304:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787393275.290858:0:14272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393275.290919:0:14272:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8082b1600 going to sleep for 11 seconds 00000100:00100000:1.0:1787393275.290973:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338498304 00000100:00100000:1.0:1787393275.290980:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338498304 00000100:00100000:1.0:1787393275.291040:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787393275.291049:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14272:x1874217338498304:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787393275.291113:0:14884:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1787393275.291903:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787393275.291915:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db984c4e/0x19a927d9c62f25b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.291931:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbe400 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393275.291937:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db984c4e/0x19a927d9c62f25b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.291950:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db984c4e/0x19a927d9c62f25b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.291977:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db984c4e/0x19a927d9c62f25b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.291985:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db984c4e/0x19a927d9c62f25b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.292012:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787393275.292017:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005117639a/0x19a927d9c62f25b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.292024:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbfe00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393275.292027:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005117639a/0x19a927d9c62f25b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.292035:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005117639a/0x19a927d9c62f25b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.292055:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005117639a/0x19a927d9c62f25b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.292062:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005117639a/0x19a927d9c62f25b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.292076:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787393275.292080:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001531c079/0x19a927d9c62f25be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.292087:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbe200 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393275.292091:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001531c079/0x19a927d9c62f25be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.292100:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001531c079/0x19a927d9c62f25be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.292112:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001531c079/0x19a927d9c62f25be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.292120:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001531c079/0x19a927d9c62f25be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.294321:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787393275.294345:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086ba65a1/0x19a927d9c62f25c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.294372:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbf000 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393275.294378:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086ba65a1/0x19a927d9c62f25c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.294390:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086ba65a1/0x19a927d9c62f25c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.294608:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086ba65a1/0x19a927d9c62f25c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.294619:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086ba65a1/0x19a927d9c62f25c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.294653:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393275.294658:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b17d9cc5/0x19a927d9c62f25cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.294665:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbf600 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393275.294669:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b17d9cc5/0x19a927d9c62f25cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.294678:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b17d9cc5/0x19a927d9c62f25cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.294693:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b17d9cc5/0x19a927d9c62f25cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.294710:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b17d9cc5/0x19a927d9c62f25cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393275.294731:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393275.294734:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393275.294736:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393275.295350:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393275.309176:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14272:x1874217338498304:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18115us (18306us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787393275.309203:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787393275.309720:0:14272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14272:1874217338498304:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787393275.309747:0:14272:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:1.0:1787393275.328795:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1787393275.561723:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787393276.339923:0:6648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1787393276.339938:0:6648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787393276.595773:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393277.609025:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393278.632144:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393279.656005:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787393279.804730:0:15553:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787393279.804734:0:15553:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787393279.804902:0:15553:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9de81e809000 00000020:01000004:0.0:1787393279.804918:0:15553:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787393279.804930:0:15553:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787393279.804944:0:15553:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9de8180e8000) 00000020:00000080:0.0:1787393279.804962:0:15553:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787393279.826676:0:15553:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787393279.827035:0:15553:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787393279.827933:0:15553:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787393279.828172:0:15553:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787393279.828412:0:15553:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787393279.829080:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 725: rc = 0 00100000:10000000:0.0:1787393279.829168:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 725: rc = 0 00100000:10000000:0.0:1787393279.829265:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 725: rc = 0 00100000:10000000:0.0:1787393279.829755:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 325: rc = 0 00100000:10000000:0.0:1787393279.830033:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 325: rc = 0 00100000:10000000:0.0:1787393279.830278:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 325: rc = 0 00100000:10000000:0.0:1787393279.830713:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 325: rc = 0 00100000:10000000:0.0:1787393279.830992:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 325: rc = 0 00100000:10000000:0.0:1787393279.831232:0:15553:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 325: rc = 0 00000020:00000080:0.0:1787393279.832602:0:15553:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787393279.832615:0:15553:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787393279.832627:0:15553:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x19a927d9c62f25da 00000020:01000004:0.0:1787393279.832644:0:15553:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787393279.832663:0:15553:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.121@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787393279.832667:0:15553:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787393279.832673:0:15553:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787393279.832693:0:15553:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787393279.832697:0:15553:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.121@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787393279.841205:0:15553:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787393279.841240:0:15553:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.121@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787393279.841245:0:15553:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787393279.841247:0:15553:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787393279.841249:0:15553:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787393279.841250:0:15553:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787393279.841251:0:15553:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787393279.841253:0:15553:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787393279.841254:0:15553:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787393279.841256:0:15553:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787393279.841258:0:15553:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787393279.841262:0:15553:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787393279.841264:0:15553:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787393279.841266:0:15553:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787393279.841267:0:15553:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787393279.841268:0:15553:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787393279.841269:0:15553:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787393279.841270:0:15553:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787393279.841271:0:15553:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787393279.841272:0:15553:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787393279.841273:0:15553:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787393279.841315:0:15553:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787393279.841340:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338498432:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787393279.841409:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393279.841631:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8082d3000 going to sleep for 11 seconds 00000100:00100000:1.0:1787393279.841732:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338498432 00000100:00100000:1.0:1787393279.841739:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338498432 00000100:00100000:1.0:1787393279.841818:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787393279.841828:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:15553:x1874217338498432:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787393279.841874:0:14243:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787393279.841877:0:14243:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787393279.841889:0:14243:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787393279.851139:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:15553:x1874217338498432:12345-0@lo:253:mount.lustre.0 Request processed in 9302us (9719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393279.851157:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787393279.851243:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338498432:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787393279.851257:0:15553:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787393279.851261:0:15553:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787393279.851275:0:15553:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787393279.851276:0:15553:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787393279.851277:0:15553:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787393279.851278:0:15553:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787393279.851280:0:15553:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787393279.851281:0:15553:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787393279.851282:0:15553:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787393279.851284:0:15553:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787393279.851316:0:15553:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9de81e809000 from lustre-OST0001 10000000:01000000:0.0:1787393279.851340:0:15553:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787393279.851343:0:15553:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787393279.851350:0:15553:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9de8180eb380 local copy 00010000:00010000:0.0:1787393279.851360:0:15553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80385b400/0x19a927d9c62f2387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f238e expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393279.851634:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338498560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787393279.851673:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393279.851754:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8055b7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787393279.851799:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338498560 00000100:00100000:3.0:1787393279.851805:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338498560 00000100:00100000:3.0:1787393279.851895:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787393279.851906:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e87b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:15553:x1874217338498560:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787393279.852090:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e87b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:15553:x1874217338498560:12345-0@lo:501:mount.lustre.0 Request processed in 186us (415us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787393279.852098:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787393279.852167:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338498560:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787393279.852181:0:15553:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787393279.852340:0:15553:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787393279.852348:0:15553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80385b400/0x19a927d9c62f2387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f238e expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393279.852358:0:15553:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de80385b400/0x19a927d9c62f2387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f238e expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393279.852379:0:15553:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9de81e809000 10000000:01000000:1.0:1787393279.852383:0:15553:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787393279.852387:0:15553:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787393279.852390:0:15553:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787393279.852394:0:15553:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787393279.852397:0:15553:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787393279.852420:0:15553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f25e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393279.852439:0:15553:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f25e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393279.852448:0:15553:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f25e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393279.852462:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338498688:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787393279.852491:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393279.852673:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787393279.852758:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338498688 00000100:00100000:0.0:1787393279.852764:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338498688 00000100:00100000:0.0:1787393279.852790:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787393279.852796:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8181fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:15553:x1874217338498688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787393279.852806:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393279.852818:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de82ffbf800/0x19a927d9c62f25e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f25e1 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.852860:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de82ffbf800/0x19a927d9c62f25e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f25e1 expref: 17 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.852873:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de82ffbf800/0x19a927d9c62f25e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f25e1 expref: 17 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.852895:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de82ffbf800, rc 0) 00000100:00100000:0.0:1787393279.852936:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8181fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:15553:x1874217338498688:12345-0@lo:101:mount.lustre.0 Request processed in 139us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393279.852943:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787393279.853027:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338498688:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787393279.853047:0:15553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f25e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f25e8 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393279.853056:0:15553:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f25e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f25e8 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787393279.853629:0:15553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787393279.854496:0:15553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787393279.854744:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787393279.854787:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787393279.854819:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787393279.854904:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787393279.854942:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787393279.854974:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787393279.855041:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787393279.855049:0:15553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787393279.855121:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338498816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787393279.855177:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393279.855214:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787393279.855379:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338498816 00000100:00100000:0.0:1787393279.855386:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338498816 00000100:00100000:0.0:1787393279.855420:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787393279.855441:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8181fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:15553:x1874217338498816:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787393279.855833:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8181fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:15553:x1874217338498816:12345-0@lo:501:mount.lustre.0 Request processed in 393us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393279.855867:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787393279.856139:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338498816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787393279.856177:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338498944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787393279.856219:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393279.856282:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787393279.856321:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338498944 00000100:00100000:0.0:1787393279.856326:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338498944 00000100:00100000:0.0:1787393279.856397:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787393279.856406:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8181fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:15553:x1874217338498944:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787393279.856701:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8181fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:15553:x1874217338498944:12345-0@lo:503:mount.lustre.0 Request processed in 296us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393279.856709:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787393279.856796:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338498944:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787393279.857315:0:15553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787393279.857376:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338499072:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787393279.857418:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393279.857710:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787393279.857785:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338499072 00000100:00100000:3.0:1787393279.857792:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338499072 00000100:00100000:3.0:1787393279.857990:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787393279.857997:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8181fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:15553:x1874217338499072:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787393279.858284:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8181fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:15553:x1874217338499072:12345-0@lo:502:mount.lustre.0 Request processed in 285us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393279.858291:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787393279.858551:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338499072:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787393279.858814:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787393279.858976:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787393279.859011:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787393279.859059:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787393279.859097:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787393279.859131:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787393279.859176:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787393279.859212:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787393279.859259:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787393279.859294:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338499200:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787393279.859360:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393279.859518:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787393279.859574:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338499200 00000100:00100000:2.0:1787393279.859580:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338499200 00000100:00100000:3.0:1787393279.859635:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787393279.859645:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8181fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:15553:x1874217338499200:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787393279.859821:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8181fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:15553:x1874217338499200:12345-0@lo:502:mount.lustre.0 Request processed in 177us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393279.859828:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787393279.859995:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338499200:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787393279.860076:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787393279.860085:0:15553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787393279.861228:0:15554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787393279.861239:0:15554:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787393279.861246:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787393279.861248:0:15554:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787393279.861254:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787393279.861269:0:15554:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9de8180ecd40) 00000020:00000080:0.0:1787393279.861290:0:15554:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787393279.861296:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787393279.861372:0:15554:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9de81e809000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787393279.861380:0:15554:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787393279.861387:0:15554:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x19a927d9c62f25f6 00010000:00010000:0.0:1787393279.865163:0:15554:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1787393279.865650:0:15554:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1787393279.867333:0:15554:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787393279.874930:0:15554:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787393279.874942:0:15554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787393279.874949:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393279.874951:0:15554:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787393279.874955:0:15554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787393279.874959:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393279.874961:0:15554:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787393279.874964:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787393279.874966:0:15554:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787393279.874968:0:15554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787393279.874971:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393279.874972:0:15554:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787393279.874975:0:15554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787393279.874977:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393279.874985:0:15554:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787393279.874990:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787393279.875051:0:15554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787393279.875054:0:15554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787393279.875056:0:15554:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787393279.875059:0:15554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787393279.880393:0:15553:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787393279.880434:0:15553:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787393279.880481:0:15553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f25e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f25e8 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393279.880508:0:15553:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de80385b800/0x19a927d9c62f25e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f25e8 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393279.880517:0:15553:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de81e809000 from 1 10000000:01000000:2.0:1787393279.880520:0:15553:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787393279.880556:0:15553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8186b5600/0x19a927d9c62f25fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393279.880564:0:15553:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8186b5600/0x19a927d9c62f25fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393279.880574:0:15553:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8186b5600/0x19a927d9c62f25fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393279.880601:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338499328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787393279.880669:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393279.880712:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338499328 00000100:00100000:2.0:1787393279.880712:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787393279.880719:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338499328 00000100:00100000:3.0:1787393279.880762:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787393279.880772:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8181fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:15553:x1874217338499328:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787393279.880784:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393279.880797:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de800031a00/0x19a927d9c62f2604 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f25fd expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393279.880829:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de800031a00/0x19a927d9c62f2604 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f25fd expref: 18 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393279.880866:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de800031a00/0x19a927d9c62f2604 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f25fd expref: 18 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393279.880875:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800031a00, rc 0) 00000100:00100000:3.0:1787393279.880914:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8181fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:15553:x1874217338499328:12345-0@lo:101:mount.lustre.0 Request processed in 144us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393279.880921:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787393279.881018:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338499328:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787393279.881036:0:15553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8186b5600/0x19a927d9c62f25fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2604 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393279.881046:0:15553:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8186b5600/0x19a927d9c62f25fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f2604 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787393279.881568:0:15553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787393279.881862:0:15553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787393279.882069:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787393279.882112:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787393279.882170:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787393279.882179:0:15553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787393279.882229:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338499456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787393279.882271:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393279.882321:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787393279.882622:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338499456 00000100:00100000:3.0:1787393279.882638:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338499456 00000100:00100000:3.0:1787393279.882680:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787393279.882688:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8181fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:15553:x1874217338499456:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787393279.882898:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8181fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:15553:x1874217338499456:12345-0@lo:501:mount.lustre.0 Request processed in 210us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393279.882906:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787393279.883078:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338499456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787393279.883106:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338499584:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787393279.883142:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393279.883175:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787393279.883454:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338499584 00000100:00100000:3.0:1787393279.883459:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338499584 00000100:00100000:3.0:1787393279.883487:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787393279.883494:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8181fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:15553:x1874217338499584:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787393279.883696:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8181fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:15553:x1874217338499584:12345-0@lo:503:mount.lustre.0 Request processed in 202us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393279.883704:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787393279.884029:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338499584:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787393279.885266:0:15553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787393279.888567:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338499712:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787393279.888649:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393279.888760:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787393279.890782:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338499712 00000100:00100000:2.0:1787393279.890795:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338499712 00000100:00100000:2.0:1787393279.890879:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787393279.890889:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8181ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:15553:x1874217338499712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787393279.891207:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8181ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:15553:x1874217338499712:12345-0@lo:502:mount.lustre.0 Request processed in 319us (2556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393279.891216:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787393279.891357:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338499712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787393279.891596:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787393279.891652:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787393279.891699:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787393279.891736:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787393279.891772:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787393279.891822:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787393279.891896:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787393279.891929:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787393279.891966:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338499840:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787393279.892014:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393279.892047:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de827b33000 going to sleep for 11 seconds 00000100:00100000:1.0:1787393279.892170:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338499840 00000100:00100000:1.0:1787393279.892176:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338499840 00000100:00100000:1.0:1787393279.892207:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787393279.892214:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f76c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:15553:x1874217338499840:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787393279.892399:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f76c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:15553:x1874217338499840:12345-0@lo:502:mount.lustre.0 Request processed in 184us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393279.892407:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787393279.892594:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338499840:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787393279.892686:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787393279.892705:0:15553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787393279.896801:0:15558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787393279.896815:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393279.896818:0:15558:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787393279.896828:0:15558:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9de81e809000 00000020:00000080:2.0:1787393279.897047:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787393279.897055:0:15558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787393279.897058:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393279.897059:0:15558:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787393279.897062:0:15558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787393279.897065:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393279.897066:0:15558:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787393279.897069:0:15558:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9de81e809000 00000020:00000080:2.0:1787393279.897071:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787393279.897168:0:15558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787393279.897172:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393279.897173:0:15558:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787393279.897176:0:15558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787393279.897179:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393279.897180:0:15558:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787393279.897184:0:15558:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9de81e809000 00000020:00000080:2.0:1787393279.897186:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787393279.898946:0:15558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787393279.898955:0:15558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787393279.898958:0:15558:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787393279.898964:0:15558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787393279.907827:0:15553:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787393279.907881:0:15553:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787393279.907905:0:15553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8186b5600/0x19a927d9c62f25fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2604 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393279.907919:0:15553:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8186b5600/0x19a927d9c62f25fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2604 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393279.907964:0:15553:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787393279.907967:0:15553:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9de81e809000 10000000:01000000:1.0:1787393279.907970:0:15553:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9de81e809000 10000000:01000000:1.0:1787393279.907974:0:15553:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787393279.907979:0:15553:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9de81e809000 from 1 10000000:01000000:1.0:1787393279.907982:0:15553:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787393279.908014:0:15553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80385b200/0x19a927d9c62f260b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393279.908023:0:15553:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de80385b200/0x19a927d9c62f260b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393279.908045:0:15553:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de80385b200/0x19a927d9c62f260b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393279.908068:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338499968:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787393279.908131:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393279.908176:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338499968 00000100:00100000:1.0:1787393279.908183:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338499968 00000100:00100000:1.0:1787393279.908224:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787393279.908234:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f76d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:15553:x1874217338499968:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787393279.908248:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393279.908260:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80385b600/0x19a927d9c62f2612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f260b expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393279.908283:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80385b600/0x19a927d9c62f2612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f260b expref: 19 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393279.908294:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80385b600/0x19a927d9c62f2612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f260b expref: 19 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393279.908315:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385b600, rc 0) 00000100:00100000:1.0:1787393279.908349:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f76d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:15553:x1874217338499968:12345-0@lo:101:mount.lustre.0 Request processed in 116us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393279.908356:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787393279.908400:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978840 going to sleep for 11 seconds 00000100:00100000:1.0:1787393279.908421:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338499968:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787393279.908434:0:15553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de80385b200/0x19a927d9c62f260b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2612 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393279.908449:0:15553:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de80385b200/0x19a927d9c62f260b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f2612 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787393279.909627:0:15553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787393279.910411:0:15553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787393279.910693:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787393279.910738:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787393279.910773:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787393279.910821:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787393279.912064:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787393279.912138:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787393279.912177:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787393279.912211:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787393279.912261:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787393279.912312:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787393279.912350:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787393279.912401:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787393279.912439:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787393279.912489:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787393279.912540:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787393279.912576:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787393279.912610:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787393279.912654:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787393279.912688:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787393279.912723:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787393279.912774:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787393279.912809:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787393279.914964:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787393279.915083:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787393279.915123:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787393279.915159:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787393279.915222:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787393279.915261:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787393279.915292:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787393279.915386:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787393279.915423:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787393279.915453:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787393279.915487:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787393279.915549:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787393279.915586:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787393279.915634:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787393279.915668:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787393279.915762:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787393279.915770:0:15553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787393279.915898:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338500096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787393279.915962:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393279.916015:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978840 going to sleep for 11 seconds 00000100:00100000:0.0:1787393279.916122:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338500096 00000100:00100000:0.0:1787393279.916130:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338500096 00000100:00100000:0.0:1787393279.916170:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787393279.916178:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f76cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:15553:x1874217338500096:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787393279.916402:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f76cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:15553:x1874217338500096:12345-0@lo:501:mount.lustre.0 Request processed in 224us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393279.916410:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787393279.916496:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338500096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787393279.916529:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338500224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787393279.916567:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393279.916630:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978840 going to sleep for 11 seconds 00000100:00100000:0.0:1787393279.919523:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338500224 00000100:00100000:0.0:1787393279.919534:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338500224 00000100:00100000:0.0:1787393279.919591:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787393279.919602:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f76ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:15553:x1874217338500224:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787393279.919914:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f76ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:15553:x1874217338500224:12345-0@lo:503:mount.lustre.0 Request processed in 313us (3345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393279.919922:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787393279.920235:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338500224:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787393279.920767:0:15553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787393279.920962:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338500352:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787393279.921016:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393279.921096:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978840 going to sleep for 11 seconds 00000100:00100000:0.0:1787393279.921152:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338500352 00000100:00100000:0.0:1787393279.921158:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338500352 00000100:00100000:0.0:1787393279.921235:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787393279.921245:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f76e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:15553:x1874217338500352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787393279.921518:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f76e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:15553:x1874217338500352:12345-0@lo:502:mount.lustre.0 Request processed in 274us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393279.921525:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787393279.921593:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338500352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787393279.921870:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787393279.921926:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787393279.921961:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787393279.922007:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787393279.922057:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787393279.922107:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787393279.922142:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787393279.922174:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787393279.922223:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787393279.922257:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787393279.922286:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787393279.922345:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787393279.922379:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787393279.922412:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787393279.922473:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787393279.922511:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787393279.922544:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787393279.922593:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787393279.922632:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787393279.922669:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787393279.922733:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787393279.922769:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787393279.922799:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787393279.922869:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787393279.922910:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787393279.922941:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787393279.922987:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787393279.923019:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787393279.923048:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787393279.923096:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787393279.923130:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787393279.923163:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787393279.923195:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787393279.923240:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787393279.923287:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787393279.923354:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787393279.923405:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787393279.923441:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787393279.923503:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787393279.923541:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787393279.923586:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338500480:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787393279.923647:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393279.923676:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978840 going to sleep for 11 seconds 00000100:00100000:3.0:1787393279.923793:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338500480 00000100:00100000:3.0:1787393279.923801:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338500480 00000100:00100000:3.0:1787393279.923836:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787393279.923898:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f76e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:15553:x1874217338500480:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787393279.924093:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f76e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:15553:x1874217338500480:12345-0@lo:502:mount.lustre.0 Request processed in 196us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393279.924101:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787393279.924327:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338500480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787393279.924395:0:15553:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787393279.924405:0:15553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787393279.925997:0:15563:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787393279.926012:0:15563:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9de8103c4d40) 00000020:00000080:0.0:1787393279.926033:0:15563:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1787393279.926174:0:15563:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9de81e809000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787393279.926178:0:15563:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9de81e809000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787393279.926181:0:15563:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9de81e809000 3 00010000:00080000:0.0:1787393279.926359:0:15563:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9de80bb76800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.121@tcp at head 00010000:00010000:0.0:1787393279.929883:0:15563:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1787393279.929988:0:15563:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787393279.930033:0:15563:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787393279.930046:0:15563:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x19a927d9c62f2620 00000100:00080000:0.0:1787393279.930056:0:15563:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787393279.930063:0:15563:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9de80bb76800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:0.0:1787393279.930096:0:15563:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de835254a80 x1874217338500608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787393279.930127:0:15563:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787393279.930436:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3323:1874217338500608:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787393279.930507:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787393279.930599:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787393279.930605:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787393279.930607:0:36:0:(import.c:65:import_set_state_nolock()) ffff9de80929d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787393279.930611:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 424 00000100:00080000:2.0:1787393279.930615:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787393279.930619:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9de80929d800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:2.0:1787393279.930636:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de83c5a4e00 x1874217338500864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787393279.930769:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338500992:0@lo:400:kworker.0 00000100:00100000:2.0:1787393279.930797:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393279.930821:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787393279.930827:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338500736:0@lo:400:kworker.0 00000100:00100000:2.0:1787393279.930892:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393279.930925:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338500608 00000100:00100000:2.0:1787393279.930932:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338500608 00000100:00100000:2.0:1787393279.930959:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338500992 00000100:00100000:2.0:1787393279.930963:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338500992 00000100:00100000:2.0:1787393279.930988:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787393279.930996:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338500992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393279.931044:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338500992:12345-0@lo:400:kworker.0 Request processed in 48us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393279.931051:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787393279.931067:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787393279.931072:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3323:x1874217338500608:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787393279.931092:0:14249:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 429 last 0 00000020:00000080:2.0:1787393279.931130:0:14249:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x19a927d9c62f2627 00000004:00100000:2.0:1787393279.931145:0:14249:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787393279.931180:0:14249:0:(import.c:65:import_set_state_nolock()) ffff9de81ea70000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787393279.931218:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1874217338500608:12345-0@lo:38:llog_process_th.0 Request processed in 145us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393279.931224:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787393279.931245:0:14886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338500736 00000100:00100000:2.0:1787393279.931249:0:14886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338500736 00000100:00100000:1.0:1787393279.931269:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338501120:0@lo:400:kworker.0 00000100:00100000:2.0:1787393279.931288:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787393279.931314:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393279.931320:0:14886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338500736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393279.931362:0:14886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338500736:12345-0@lo:400:kworker.0 Request processed in 45us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393279.931369:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787393279.931376:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338501120 00000100:00100000:1.0:1787393279.931381:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338501120 00000100:00100000:2.0:1787393279.931405:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338500864:0@lo:8:kworker.0 00000100:00100000:1.0:1787393279.931410:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787393279.931419:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338501120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393279.931437:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393279.931465:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1874217338501120:12345-0@lo:400:kworker.0 Request processed in 46us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393279.931474:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787393279.931476:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de835254a80 x1874217338500608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787393289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393279.931487:0:3323:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787393279.931494:0:3323:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787393279.931503:0:3323:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00010000:00080000:1.0:1787393279.931506:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de83c5a7100 x1874217338501120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787393279.931508:0:3323:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787393279.931513:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de80bb76800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787393279.931524:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3323:1874217338500608:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787393279.931525:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1874217338501120:0@lo:400:kworker.0 00000100:00100000:2.0:1787393279.931562:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338500864 00000100:00100000:2.0:1787393279.931567:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338500864 00000100:00100000:2.0:1787393279.931592:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787393279.931597:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3323:x1874217338500864:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787393279.931637:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3323:x1874217338500864:12345-0@lo:8:kworker.0 Request processed in 39us (202us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787393279.931643:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787393279.931674:0:3327:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787393279.931686:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338500736:0@lo:400:kworker.0 00010000:00080000:2.0:1787393279.931700:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9de83c5a4a80 x1874217338500992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787393279.931721:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338500992:0@lo:400:kworker.0 00000100:00100000:2.0:1787393279.931746:0:3323:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787393279.931750:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de80929d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787393279.931753:0:3323:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787393279.931756:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338500864:0@lo:8:kworker.0 00000100:00080000:3.0:1787393279.931908:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787393279.931913:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787393279.932085:0:15563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787393279.932172:0:15553:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787393279.932199:0:15553:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787393279.932217:0:15553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de80385b200/0x19a927d9c62f260b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2612 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393279.932228:0:15553:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de80385b200/0x19a927d9c62f260b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f2612 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787393279.932267:0:15553:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787393279.932269:0:15553:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787393279.932271:0:15553:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787393279.932273:0:15553:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787393279.932274:0:15553:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787393279.932276:0:15553:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787393279.932277:0:15553:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787393279.932279:0:15553:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787393279.932281:0:15553:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787393279.932285:0:15553:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787393279.932287:0:15553:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787393279.932288:0:15553:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787393279.932289:0:15553:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787393279.932291:0:15553:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787393279.932292:0:15553:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787393279.932293:0:15553:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787393279.932294:0:15553:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787393279.932295:0:15553:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787393279.932310:0:15553:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787393279.932328:0:15553:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787393279.932342:0:15553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338501248:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787393279.932382:0:15553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393279.932411:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338501248 00000100:00100000:1.0:1787393279.932416:0:15553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de702978e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787393279.932417:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338501248 00000100:00100000:3.0:1787393279.932459:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787393279.932467:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f76f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:15553:x1874217338501248:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787393279.932489:0:14242:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787393279.932502:0:14242:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787393279.961132:0:14242:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787393279.961145:0:14242:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787393279.961156:0:14265:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787393279.961161:0:14265:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787393279.961337:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f262e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.961356:0:14265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de80385a600/0x19a927d9c62f2508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f2501 expref: 19 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.961366:0:14265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f262e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.961531:0:14265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de80385a600/0x19a927d9c62f2508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f2501 expref: 19 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.961547:0:14265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de80385a600/0x19a927d9c62f2508 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f2501 expref: 19 pid: 14242 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393279.961563:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835254380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14265:1874217338501376:0@lo:104: 00000100:00100000:0.0:1787393279.961627:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393279.961677:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de81878e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787393279.961880:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338501376 00000100:00100000:3.0:1787393279.961887:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338501376 00000100:00100000:3.0:1787393279.961929:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787393279.961938:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+3:14265:x1874217338501376:12345-0@lo:104: 00010000:00010000:3.0:1787393279.961949:0:14232:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f2501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f2508 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393279.961998:0:14232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787393279.962004:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+3:14265:x1874217338501376:12345-0@lo:104: Request processed in 68us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393279.962010:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787393279.962033:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393279.962038:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f2501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f2508 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393279.962056:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80761c000 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1787393279.962060:0:14238:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f2501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f2508 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393279.962068:0:14238:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f2501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f2508 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787393279.962074:0:14238:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f2501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f2508 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393279.962079:0:14238:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787393279.962105:0:14238:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f2501 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2508 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393279.962112:0:14238:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787393279.962127:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f2501 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2508 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393279.962133:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de80761c000/0x19a927d9c62f2501 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2508 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393279.962133:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835254380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14265:1874217338501376:0@lo:104: 00010000:00010000:3.0:1787393279.962147:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393279.962149:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393279.962150:0:14265:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f262e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393279.962151:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393279.962667:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3325:1874217338501504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787393279.962703:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393279.962868:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338501504 00000100:00100000:0.0:1787393279.962873:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338501504 00010000:00010000:0.0:1787393279.962893:0:14236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de80385a600/0x19a927d9c62f2508 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f2501 expref: 20 pid: 14242 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393279.962918:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787393279.962925:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835328e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+20:3325:x1874217338501504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787393279.962935:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393279.962940:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de80385a600/0x19a927d9c62f2508 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f2501 expref: 20 pid: 14242 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.962950:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de80385a600/0x19a927d9c62f2508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f2501 expref: 20 pid: 14242 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.962963:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80385a600/0x19a927d9c62f2508 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f2501 expref: 20 pid: 14242 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.962986:0:14236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f262e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.962993:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f262e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787393279.963005:0:14236:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007543549s 00010000:00010000:0.0:1787393279.963009:0:14236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f262e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.963015:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f262e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.963022:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f262e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.963028:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f262e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.963035:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbfc00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393279.963039:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f262e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.963047:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f262e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.963060:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f262e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.963069:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787393279.963108:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835328e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:3325:x1874217338501504:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393279.963116:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787393279.963148:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3325:1874217338501504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787393279.963167:0:14265:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f262e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.963174:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f262e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393279.963179:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f262e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393279.971385:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f76f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:15553:x1874217338501248:12345-0@lo:253:mount.lustre.0 Request processed in 38905us (38988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393279.971403:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787393279.971573:0:15553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:15553:1874217338501248:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787393279.971589:0:15553:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787393279.971605:0:15553:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787393279.971607:0:15553:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787393279.971609:0:15553:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787393279.971610:0:15553:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787393279.971611:0:15553:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787393279.971613:0:15553:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787393279.971614:0:15553:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787393279.971616:0:15553:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787393279.971617:0:15553:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787393279.971632:0:15553:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787393279.978180:0:15553:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787393279.979929:0:15553:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787393279.980118:0:15553:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787393279.980269:0:15553:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787393279.980745:0:15553:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787393279.981205:0:15553:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787393279.982945:0:15553:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787393280.027994:0:15553:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787393280.028004:0:15553:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787393280.028039:0:15553:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787393280.028127:0:15553:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787393280.028144:0:15553:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787393280.028192:0:15553:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:0.0:1787393280.361670:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787393280.361694:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338501632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787393280.361767:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393280.361854:0:14888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338501632 00000100:00100000:0.0:1787393280.361861:0:14888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338501632 00000100:00100000:0.0:1787393280.361910:0:14888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787393280.361920:0:14888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338501632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787393280.361955:0:14888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787393280.362084:0:14888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338501632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393280.362092:0:14888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787393280.362147:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338501632:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787393280.680710:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787393281.255922:0:14246:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787393281.255931:0:14246:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9de83f587000 from 8 10000000:01000000:0.0:1787393281.255937:0:14246:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787393281.255984:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de82ffbea00/0x19a927d9c62f2635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393281.255998:0:14246:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de82ffbea00/0x19a927d9c62f2635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393281.256008:0:14246:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de82ffbea00/0x19a927d9c62f2635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393281.256034:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835257800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338501760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787393281.256100:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393281.256156:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8102a10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787393281.256254:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338501760 00000100:00100000:1.0:1787393281.256276:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338501760 00000100:00100000:1.0:1787393281.256360:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787393281.256370:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:14246:x1874217338501760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787393281.256383:0:14243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393281.256396:0:14243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de80385aa00/0x19a927d9c62f263c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f2635 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393281.256427:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de80385aa00/0x19a927d9c62f263c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f2635 expref: 19 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393281.256437:0:14243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de80385aa00/0x19a927d9c62f263c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f2635 expref: 19 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393281.256446:0:14243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de80385aa00, rc 0) 00000100:00100000:1.0:1787393281.256499:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:14246:x1874217338501760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393281.256512:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787393281.256651:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835257800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338501760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787393281.256674:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de82ffbea00/0x19a927d9c62f2635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f263c expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393281.256683:0:14246:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de82ffbea00/0x19a927d9c62f2635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f263c expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393281.256735:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338501888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787393281.256772:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393281.256798:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de827b33240 going to sleep for 11 seconds 00000100:00100000:0.0:1787393281.256871:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338501888 00000100:00100000:0.0:1787393281.256877:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338501888 00000100:00100000:0.0:1787393281.256915:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787393281.256922:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:14246:x1874217338501888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787393281.256935:0:14244:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787393281.256950:0:14244:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787393281.256953:0:14244:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787393281.257023:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:14246:x1874217338501888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393281.257031:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787393281.257125:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338501888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787393281.257199:0:14246:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787393281.257206:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de82ffbea00/0x19a927d9c62f2635 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f263c expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393281.257213:0:14246:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de82ffbea00/0x19a927d9c62f2635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f263c expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393281.705309:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787393282.287191:0:14283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787393282.728493:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393283.754729:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393284.783673:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787393284.968644:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787393284.968651:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787393284.968655:0:37:0:(import.c:65:import_set_state_nolock()) ffff9de80929d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787393284.968668:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9de80929d800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:1.0:1787393284.968692:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9de835329c00 x1874217338502272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787393284.968751:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3327:1874217338502016:0@lo:400:kworker.0 00000100:00100000:1.0:1787393284.968823:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393284.968893:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338502656:0@lo:400:kworker.0 00000100:00100000:1.0:1787393284.968924:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393284.968948:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787393284.968953:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338502528:0@lo:400:kworker.0 00000100:00100000:1.0:1787393284.968977:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393284.969005:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338502144:0@lo:400:kworker.0 00000100:00100000:1.0:1787393284.969030:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393284.969048:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787393284.969052:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338502400:0@lo:400:kworker.0 00000100:00100000:1.0:1787393284.969074:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393284.969100:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338502272:0@lo:8:kworker.0 00000100:00100000:1.0:1787393284.969142:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393284.969188:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338502016 00000100:00100000:1.0:1787393284.969195:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338502016 00000100:00100000:1.0:1787393284.969245:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787393284.969254:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de80ba46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:3327:x1874217338502016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393284.969309:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de80ba46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:3327:x1874217338502016:12345-0@lo:400:kworker.0 Request processed in 56us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393284.969325:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787393284.969355:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338502656 00000100:00100000:1.0:1787393284.969358:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338502656 00000100:00100000:1.0:1787393284.969384:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338502528 00000100:00100000:1.0:1787393284.969386:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338502528 00000100:00100000:1.0:1787393284.969398:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338502400 00000100:00100000:1.0:1787393284.969400:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338502400 00000100:00100000:1.0:1787393284.969410:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787393284.969414:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874217338502656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393284.969443:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1874217338502656:12345-0@lo:400:kworker.0 Request processed in 28us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393284.969448:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787393284.969459:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787393284.969463:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338502528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393284.969482:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338502528:12345-0@lo:400:kworker.0 Request processed in 19us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393284.969492:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787393284.969502:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787393284.969507:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338502400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393284.969537:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338502400:12345-0@lo:400:kworker.0 Request processed in 29us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393284.969542:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787393284.969562:0:14886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338502144 00000100:00100000:1.0:1787393284.969572:0:14886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338502144 00000100:00100000:1.0:1787393284.969597:0:14886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338502272 00000100:00100000:1.0:1787393284.969600:0:14886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338502272 00000100:00100000:1.0:1787393284.969610:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787393284.969615:0:14886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835329f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338502144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393284.969645:0:14886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835329f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338502144:12345-0@lo:400:kworker.0 Request processed in 29us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393284.969651:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787393284.969663:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787393284.969667:0:14886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3323:x1874217338502272:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787393284.969688:0:14886:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:1.0:1787393284.969715:0:14886:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19a927d9c62f2643 00002000:00100000:1.0:1787393284.969729:0:14886:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9de7012a8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787393284.969732:0:14886:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787393284.969735:0:14886:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787393284.970054:0:14886:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787393284.970076:0:14886:0:(import.c:65:import_set_state_nolock()) ffff9de7012a9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787393284.970113:0:14886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3323:x1874217338502272:12345-0@lo:8:kworker.0 Request processed in 444us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393284.970119:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787393284.970144:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787393284.970149:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787393284.970175:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de835329c00 x1874217338502272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787393309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787393284.970189:0:3323:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787393284.970196:0:3323:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787393284.970201:0:3323:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787393284.970210:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9de80929d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787393284.970223:0:3323:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787393284.970229:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3323:1874217338502272:0@lo:8:kworker.0 00000004:00080000:1.0:1787393284.970287:0:14274:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787393284.970305:0:14274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834b46680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14274:1874217338502912:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787393284.970333:0:14274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393284.970350:0:14274:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83c61d600 going to sleep for 11 seconds 00000004:00080000:1.0:1787393284.970364:0:14273:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787393284.970696:0:14273:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 434145855983ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787393284.970934:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787393284.970945:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338502784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787393284.970976:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393284.971011:0:14889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338502784 00000100:00100000:1.0:1787393284.971016:0:14889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338502784 00000100:00100000:1.0:1787393284.971052:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787393284.971061:0:14889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3325:x1874217338502784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787393284.971083:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393284.971120:0:14889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3325:x1874217338502784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393284.971126:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787393284.971143:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787393284.971167:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de834b47b80 x1874217338502784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787393300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393284.971181:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338502784:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787393284.971209:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de835329180 x1874217338502400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393284.971230:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338502400:0@lo:400:kworker.0 00000100:00100000:1.0:1787393284.971247:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338502144:0@lo:400:kworker.0 00010000:00080000:1.0:1787393284.971615:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de835328000 x1874217338502528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393284.971625:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338502528:0@lo:400:kworker.0 00000100:00100000:1.0:1787393284.971635:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3327:1874217338502016:0@lo:400:kworker.0 00010000:00080000:1.0:1787393284.971646:0:3327:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9de83532ad80 x1874217338502656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787393300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787393284.971655:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1874217338502656:0@lo:400:kworker.0 00000100:00100000:1.0:1787393284.971678:0:14886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338502912 00000100:00100000:1.0:1787393284.971681:0:14886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338502912 00000100:00100000:1.0:1787393284.971705:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787393284.971710:0:14886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14274:x1874217338502912:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787393284.980988:0:14886:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787393284.980999:0:14886:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787393284.981005:0:14886:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:1.0:1787393285.003027:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.003040:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d2a8925/0x19a927d9c62f264a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003057:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.003061:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.003068:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d2a8925/0x19a927d9c62f264a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003094:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d2a8925/0x19a927d9c62f264a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003104:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d2a8925/0x19a927d9c62f264a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003110:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d2a8925/0x19a927d9c62f264a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003125:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787393285.003770:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.003777:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008def8084/0x19a927d9c62f2651 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003786:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.003789:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.003793:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008def8084/0x19a927d9c62f2651 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003802:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008def8084/0x19a927d9c62f2651 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003810:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008def8084/0x19a927d9c62f2651 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003828:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008def8084/0x19a927d9c62f2651 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003869:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787393285.003883:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787393285.003888:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d2a8925/0x19a927d9c62f264a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003896:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385b000 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:1.0:1787393285.003901:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d2a8925/0x19a927d9c62f264a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003910:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d2a8925/0x19a927d9c62f264a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003926:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d2a8925/0x19a927d9c62f264a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003933:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d2a8925/0x19a927d9c62f264a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003949:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787393285.003952:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008def8084/0x19a927d9c62f2651 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003968:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a200 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:1.0:1787393285.003971:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008def8084/0x19a927d9c62f2651 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003979:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008def8084/0x19a927d9c62f2651 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003988:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008def8084/0x19a927d9c62f2651 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.003994:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008def8084/0x19a927d9c62f2651 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.004006:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393285.004007:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393285.004009:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393285.004406:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787393285.011036:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.011052:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000006574dc/0x19a927d9c62f2658 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.011072:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.011076:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.011082:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000006574dc/0x19a927d9c62f2658 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.011096:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000006574dc/0x19a927d9c62f2658 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.011114:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000006574dc/0x19a927d9c62f2658 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.011121:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000006574dc/0x19a927d9c62f2658 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.011216:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787393285.011780:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.011789:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6bc42c7/0x19a927d9c62f265f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.011799:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.011802:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.011807:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6bc42c7/0x19a927d9c62f265f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.011816:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6bc42c7/0x19a927d9c62f265f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.011824:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6bc42c7/0x19a927d9c62f265f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.011831:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6bc42c7/0x19a927d9c62f265f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.011891:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787393285.011906:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787393285.011911:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000006574dc/0x19a927d9c62f2658 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.011919:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385ae00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:1.0:1787393285.011923:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000006574dc/0x19a927d9c62f2658 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.011933:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000006574dc/0x19a927d9c62f2658 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.011948:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000006574dc/0x19a927d9c62f2658 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.011954:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000006574dc/0x19a927d9c62f2658 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.011971:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787393285.011974:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6bc42c7/0x19a927d9c62f265f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.011981:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385ac00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:1.0:1787393285.011984:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6bc42c7/0x19a927d9c62f265f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.012002:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6bc42c7/0x19a927d9c62f265f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.012013:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6bc42c7/0x19a927d9c62f265f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.012020:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6bc42c7/0x19a927d9c62f265f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.012032:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393285.012033:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393285.012035:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393285.012331:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787393285.013187:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.013196:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054c97df4/0x19a927d9c62f2666 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.013207:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.013211:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.013216:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054c97df4/0x19a927d9c62f2666 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.013227:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054c97df4/0x19a927d9c62f2666 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.013236:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054c97df4/0x19a927d9c62f2666 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.013251:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054c97df4/0x19a927d9c62f2666 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.013278:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787393285.013290:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787393285.013294:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054c97df4/0x19a927d9c62f2666 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.013302:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385be00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:1.0:1787393285.013307:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054c97df4/0x19a927d9c62f2666 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.013316:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054c97df4/0x19a927d9c62f2666 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.013330:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054c97df4/0x19a927d9c62f2666 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.013338:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054c97df4/0x19a927d9c62f2666 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.013353:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393285.013355:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393285.013356:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787393285.013756:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.013769:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000940ac1fb/0x19a927d9c62f266d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.013777:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.013780:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.013785:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000940ac1fb/0x19a927d9c62f266d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.013793:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000940ac1fb/0x19a927d9c62f266d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.013801:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000940ac1fb/0x19a927d9c62f266d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.013808:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000940ac1fb/0x19a927d9c62f266d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.013825:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787393285.014217:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.014223:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa4fe915/0x19a927d9c62f2674 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.014231:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.014234:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.014238:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa4fe915/0x19a927d9c62f2674 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.014247:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa4fe915/0x19a927d9c62f2674 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.014829:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa4fe915/0x19a927d9c62f2674 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.014868:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa4fe915/0x19a927d9c62f2674 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.014887:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787393285.015284:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787393285.015291:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000940ac1fb/0x19a927d9c62f266d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.015300:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385bc00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393285.015304:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000940ac1fb/0x19a927d9c62f266d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.015313:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000940ac1fb/0x19a927d9c62f266d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.015330:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000940ac1fb/0x19a927d9c62f266d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.015336:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000940ac1fb/0x19a927d9c62f266d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.015366:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787393285.015369:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa4fe915/0x19a927d9c62f2674 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.015375:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a800 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393285.015378:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa4fe915/0x19a927d9c62f2674 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.015385:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa4fe915/0x19a927d9c62f2674 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.015405:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa4fe915/0x19a927d9c62f2674 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.015413:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa4fe915/0x19a927d9c62f2674 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.015425:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393285.015427:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393285.015428:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787393285.015757:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.015764:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cbd7d17/0x19a927d9c62f267b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.015774:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.015777:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.015782:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cbd7d17/0x19a927d9c62f267b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.015792:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cbd7d17/0x19a927d9c62f267b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.015800:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cbd7d17/0x19a927d9c62f267b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.015808:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cbd7d17/0x19a927d9c62f267b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.015873:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787393285.016312:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787393285.016318:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cbd7d17/0x19a927d9c62f267b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.016326:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de80385a600 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393285.016335:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cbd7d17/0x19a927d9c62f267b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.016343:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cbd7d17/0x19a927d9c62f267b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.016354:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cbd7d17/0x19a927d9c62f267b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.016360:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cbd7d17/0x19a927d9c62f267b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.016375:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393285.016376:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393285.016378:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787393285.016648:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.016655:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f2682 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.016663:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.016666:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.016669:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f2682 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.016677:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f2682 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.016684:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f2682 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.016691:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f2682 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.016713:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787393285.017309:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393285.017322:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f2682 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.017331:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8600 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393285.017335:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f2682 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.017343:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f2682 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.017358:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f2682 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.017365:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f2682 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.017383:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393285.017385:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393285.017387:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393285.019029:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787393285.020298:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.020310:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015de33c9/0x19a927d9c62f2689 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.020325:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.020335:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.020340:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015de33c9/0x19a927d9c62f2689 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.020354:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015de33c9/0x19a927d9c62f2689 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.020363:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015de33c9/0x19a927d9c62f2689 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.020371:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015de33c9/0x19a927d9c62f2689 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.020387:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787393285.025973:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.025984:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2690 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.026000:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.026005:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.026011:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2690 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.026024:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2690 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.026034:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2690 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.026050:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2690 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.026069:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787393285.026479:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.026486:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2697 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.026494:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.026497:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.026500:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2697 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.026508:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2697 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.026516:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2697 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.026522:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2697 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.026530:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787393285.026930:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.026935:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f269e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.026947:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.026950:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.026953:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f269e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.026961:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f269e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.026968:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f269e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.026974:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f269e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.026982:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1787393285.027424:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787393285.027431:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015de33c9/0x19a927d9c62f2689 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027440:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9200 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393285.027445:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015de33c9/0x19a927d9c62f2689 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027465:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015de33c9/0x19a927d9c62f2689 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027482:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015de33c9/0x19a927d9c62f2689 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027490:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015de33c9/0x19a927d9c62f2689 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027511:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787393285.027514:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2690 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027520:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9e00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393285.027523:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2690 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027529:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2690 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027537:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2690 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027543:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2690 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027565:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787393285.027569:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2697 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027576:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8200 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393285.027579:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2697 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027586:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2697 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027596:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2697 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027602:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2697 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027613:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393285.027616:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f269e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027622:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8a00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393285.027625:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f269e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027643:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f269e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027655:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f269e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027662:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f269e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.027676:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393285.027678:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393285.027680:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393285.027922:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787393285.031810:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.031825:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069d7705d/0x19a927d9c62f26a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.032315:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.032321:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.032328:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069d7705d/0x19a927d9c62f26a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.032343:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069d7705d/0x19a927d9c62f26a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.032371:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069d7705d/0x19a927d9c62f26a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.032379:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069d7705d/0x19a927d9c62f26a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.032437:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787393285.033018:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.033026:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.033034:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.033038:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.033042:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.033051:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.033059:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.033067:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.036539:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787393285.036554:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069d7705d/0x19a927d9c62f26a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.036568:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9600 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393285.036573:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069d7705d/0x19a927d9c62f26a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.036585:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069d7705d/0x19a927d9c62f26a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.036607:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069d7705d/0x19a927d9c62f26a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.036630:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069d7705d/0x19a927d9c62f26a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.037050:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393285.037056:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.037064:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9a00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393285.037067:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.037074:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.037086:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.037093:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393285.037094:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393285.037096:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393285.037410:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787393285.037419:0:14886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.038980:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787393285.040463:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.040476:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000630b867f/0x19a927d9c62f26b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.040492:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.040496:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.040503:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000630b867f/0x19a927d9c62f26b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.040518:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000630b867f/0x19a927d9c62f26b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.040527:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000630b867f/0x19a927d9c62f26b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.040536:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000630b867f/0x19a927d9c62f26b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.040559:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787393285.041601:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1787393285.041632:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787393285.041640:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000630b867f/0x19a927d9c62f26b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.041650:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8e00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393285.041662:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000630b867f/0x19a927d9c62f26b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.041672:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000630b867f/0x19a927d9c62f26b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.041689:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000630b867f/0x19a927d9c62f26b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.041697:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000630b867f/0x19a927d9c62f26b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393285.041716:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393285.041718:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393285.041720:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787393285.043538:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.043550:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000224a304b/0x19a927d9c62f26ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.043570:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.043574:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.043580:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000224a304b/0x19a927d9c62f26ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.043592:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000224a304b/0x19a927d9c62f26ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.043602:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000224a304b/0x19a927d9c62f26ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.043609:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000224a304b/0x19a927d9c62f26ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.043638:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787393285.045243:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393285.045254:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000224a304b/0x19a927d9c62f26ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.045278:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9000 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393285.045283:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000224a304b/0x19a927d9c62f26ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.045307:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000224a304b/0x19a927d9c62f26ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.045333:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000224a304b/0x19a927d9c62f26ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.045340:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000224a304b/0x19a927d9c62f26ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.045361:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393285.045362:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393285.045364:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787393285.045753:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.045760:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000144a7576/0x19a927d9c62f26c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.045771:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.045776:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.045782:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000144a7576/0x19a927d9c62f26c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.045793:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000144a7576/0x19a927d9c62f26c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.045813:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000144a7576/0x19a927d9c62f26c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.045820:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000144a7576/0x19a927d9c62f26c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.047169:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787393285.047754:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.047763:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bba7067/0x19a927d9c62f26c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.047778:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.047782:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.047789:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bba7067/0x19a927d9c62f26c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.047801:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bba7067/0x19a927d9c62f26c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.047810:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bba7067/0x19a927d9c62f26c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.047818:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bba7067/0x19a927d9c62f26c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.052393:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393285.052408:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000144a7576/0x19a927d9c62f26c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.052422:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8000 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393285.052427:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000144a7576/0x19a927d9c62f26c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.052438:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000144a7576/0x19a927d9c62f26c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.052460:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000144a7576/0x19a927d9c62f26c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.052479:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000144a7576/0x19a927d9c62f26c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.052504:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393285.052506:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393285.052508:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393285.057939:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787393285.058574:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.058584:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f26cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.058599:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.058603:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.058609:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f26cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.058623:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f26cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.058632:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f26cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.058640:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f26cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.058669:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787393285.059130:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.059137:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068a1cb5a/0x19a927d9c62f26d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.059145:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.059153:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.059158:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068a1cb5a/0x19a927d9c62f26d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.059167:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068a1cb5a/0x19a927d9c62f26d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.059176:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068a1cb5a/0x19a927d9c62f26d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.059182:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068a1cb5a/0x19a927d9c62f26d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.059191:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787393285.059603:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.059608:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f26dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.059617:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.059619:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.059623:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f26dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.059631:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f26dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.059638:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f26dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.059649:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f26dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.059656:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787393285.060066:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.060072:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d1931f0/0x19a927d9c62f26e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.060081:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.060084:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.060088:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d1931f0/0x19a927d9c62f26e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.060098:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d1931f0/0x19a927d9c62f26e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.060106:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d1931f0/0x19a927d9c62f26e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.060114:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d1931f0/0x19a927d9c62f26e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.060122:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787393285.060541:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.060548:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030c21114/0x19a927d9c62f26eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.060562:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.060564:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.060569:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030c21114/0x19a927d9c62f26eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.060577:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030c21114/0x19a927d9c62f26eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.060585:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030c21114/0x19a927d9c62f26eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.060592:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030c21114/0x19a927d9c62f26eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.060600:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1787393285.061015:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.061021:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f26f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.061028:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.061031:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.061035:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f26f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.061044:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f26f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.061063:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f26f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.061070:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f26f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.061079:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1787393285.061274:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787393285.061282:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bba7067/0x19a927d9c62f26c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061290:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8400 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393285.061294:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bba7067/0x19a927d9c62f26c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061303:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bba7067/0x19a927d9c62f26c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061332:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bba7067/0x19a927d9c62f26c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061339:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bba7067/0x19a927d9c62f26c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061359:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787393285.061362:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f26cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061368:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9400 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393285.061371:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f26cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061377:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f26cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061385:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f26cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061392:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f26cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061403:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787393285.061407:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068a1cb5a/0x19a927d9c62f26d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061418:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9800 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393285.061422:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068a1cb5a/0x19a927d9c62f26d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061429:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068a1cb5a/0x19a927d9c62f26d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061438:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068a1cb5a/0x19a927d9c62f26d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061444:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068a1cb5a/0x19a927d9c62f26d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061456:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787393285.061459:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f26dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061465:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8800 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393285.061468:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f26dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061475:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f26dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061485:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f26dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061498:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f26dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061511:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787393285.061515:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d1931f0/0x19a927d9c62f26e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061521:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9c00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393285.061524:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d1931f0/0x19a927d9c62f26e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061533:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d1931f0/0x19a927d9c62f26e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061543:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d1931f0/0x19a927d9c62f26e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061550:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d1931f0/0x19a927d9c62f26e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061559:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787393285.061561:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030c21114/0x19a927d9c62f26eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061567:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8c00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393285.061575:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030c21114/0x19a927d9c62f26eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061581:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030c21114/0x19a927d9c62f26eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061591:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030c21114/0x19a927d9c62f26eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061597:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030c21114/0x19a927d9c62f26eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061609:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787393285.061612:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f26f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061617:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8a00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393285.061620:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f26f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061626:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f26f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061633:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f26f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061638:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cf56104/0x19a927d9c62f26f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393285.061658:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393285.061660:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393285.061661:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393285.062561:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787393285.074494:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.074507:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.074524:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.074528:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.074534:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.074547:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.074558:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.074566:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.074607:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787393285.075179:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.075186:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2700 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.075196:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.075199:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.075204:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2700 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.075213:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2700 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.075221:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2700 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.075228:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2700 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.075242:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787393285.075651:0:14886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787393285.075657:0:14886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2707 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.075666:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787393285.075675:0:14886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393285.075679:0:14886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2707 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.075688:0:14886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2707 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.075696:0:14886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2707 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.075703:0:14886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2707 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393285.075711:0:14886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:1.0:1787393285.075919:0:14886:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1787393285.076015:0:14886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14274:x1874217338502912:12345-0@lo:5:osp-pre-1-0.0 Request processed in 104300us (105677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393285.076025:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787393285.076082:0:14274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834b46680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14274:1874217338502912:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787393285.076096:0:14274:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787393285.076136:0:14274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834b46680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14274:1874217338503040:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787393285.076167:0:14274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393285.076202:0:14274:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de8082b5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787393285.076224:0:14887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338503040 00000100:00100000:1.0:1787393285.076230:0:14887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338503040 00000100:00100000:1.0:1787393285.076277:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787393285.076286:0:14887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14274:x1874217338503040:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787393285.076330:0:14887:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1787393285.077516:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787393285.077526:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.077538:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9a00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393285.077543:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.077553:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.077573:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.077579:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fe5e58d/0x19a927d9c62f26f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.077595:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787393285.077599:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2700 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.077613:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8200 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393285.077616:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2700 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.077622:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2700 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.077631:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2700 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.077638:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071ecdb34/0x19a927d9c62f2700 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.077651:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787393285.077654:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2707 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.077660:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9e00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393285.077664:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2707 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.077671:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2707 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.077679:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2707 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.077693:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb437365/0x19a927d9c62f2707 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393285.077705:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393285.077707:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393285.077708:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393285.077716:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393285.099816:0:14887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14274:x1874217338503040:12345-0@lo:5:osp-pre-1-0.0 Request processed in 23522us (23639us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787393285.099829:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787393285.101929:0:14274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834b46680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14274:1874217338503040:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787393285.101947:0:14274:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1787393285.484536:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338503168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787393285.484602:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393285.484674:0:14889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338503168 00000100:00100000:1.0:1787393285.484682:0:14889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338503168 00000100:00100000:1.0:1787393285.484720:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787393285.484728:0:14889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338503168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787393285.484759:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393285.484803:0:14889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338503168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393285.484810:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787393285.484873:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338503168:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787393285.653078:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787393285.653129:0:7527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787393285.800081:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787393286.272012:0:15909:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787393286.824636:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393287.848183:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393288.152407:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393288.152514:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319636736 00000100:00100000:1.0:1787393288.152526:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319636736 00000100:00100000:1.0:1787393288.152577:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 74 00000100:00100000:1.0:1787393288.152587:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c04fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2352:x1874217319636736:12345-192.168.203.21@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787393288.152617:0:14243:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 01bb6f60-100d-4ad2-b4cb-711641e2fe07@192.168.203.21@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:1.0:1787393288.152649:0:14243:0:(genops.c:1406:class_connect()) connect: client 01bb6f60-100d-4ad2-b4cb-711641e2fe07, cookie 0x19a927d9c62f270e 00000100:00080000:1.0:1787393288.152783:0:14243:0:(import.c:65:import_set_state_nolock()) ffff9de7012a8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787393288.152894:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c04fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+5:2352:x1874217319636736:12345-192.168.203.21@tcp:250:mount.lustre.0 Request processed in 307us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393288.152903:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 74 00000100:00100000:1.0:1787393288.166387:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393288.166559:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319636864 00000100:00100000:2.0:1787393288.166570:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319636864 00000100:00100000:2.0:1787393288.166636:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 75 00000100:00100000:2.0:1787393288.166646:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c04c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+5:13702:x1874217319636864:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787393288.166664:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393288.166682:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8186b5800/0x19a927d9c62f2715 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0da0f expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393288.166711:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8186b5800/0x19a927d9c62f2715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da0f expref: 6 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393288.166722:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8186b5800/0x19a927d9c62f2715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da0f expref: 6 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393288.166730:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5800, rc 0) 00000100:00100000:2.0:1787393288.166790:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c04c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+6:13702:x1874217319636864:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 145us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393288.166798:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 75 00000100:00100000:2.0:1787393288.186398:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393288.186497:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319636992 00000100:00100000:0.0:1787393288.186507:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319636992 00000100:00100000:0.0:1787393288.186565:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 76 00000100:00100000:0.0:1787393288.186575:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c04d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+6:13702:x1874217319636992:12345-192.168.203.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787393288.186872:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c04d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+6:13702:x1874217319636992:12345-192.168.203.21@tcp:501:mount.lustre.0 Request processed in 265us (449us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787393288.186880:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 76 00000100:00100000:0.0:1787393288.190390:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393288.190468:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319637120 00000100:00100000:3.0:1787393288.190479:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319637120 00000100:00100000:3.0:1787393288.190548:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 77 00000100:00100000:3.0:1787393288.190568:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c04d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+6:13702:x1874217319637120:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787393288.190586:0:14243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393288.190604:0:14243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de800031800/0x19a927d9c62f271c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0da16 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393288.190632:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de800031800/0x19a927d9c62f271c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da16 expref: 7 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393288.190644:0:14243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de800031800/0x19a927d9c62f271c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da16 expref: 7 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393288.190666:0:14243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800031800, rc 0) 00000100:00100000:3.0:1787393288.190734:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c04d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+7:13702:x1874217319637120:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 178us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393288.190742:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 77 00000100:00100000:1.0:1787393288.193927:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393288.193990:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319637248 00000100:00100000:2.0:1787393288.194000:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319637248 00000100:00100000:2.0:1787393288.194048:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 78 00000100:00100000:2.0:1787393288.194057:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c04f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+7:13702:x1874217319637248:12345-192.168.203.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787393288.194507:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c04f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+8:13702:x1874217319637248:12345-192.168.203.21@tcp:501:mount.lustre.0 Request processed in 450us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393288.194515:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 78 00000100:00100000:2.0:1787393288.198730:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393288.198820:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319637376 00000100:00100000:3.0:1787393288.198831:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319637376 00000100:00100000:3.0:1787393288.198907:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 79 00000100:00100000:3.0:1787393288.198916:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c04c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+8:13702:x1874217319637376:12345-192.168.203.21@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787393288.199186:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c04c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+8:13702:x1874217319637376:12345-192.168.203.21@tcp:503:mount.lustre.0 Request processed in 269us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393288.199194:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 79 00000100:00100000:3.0:1787393288.201639:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393288.203916:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319637504 00000100:00100000:2.0:1787393288.203931:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319637504 00000100:00100000:2.0:1787393288.204001:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 80 00000100:00100000:2.0:1787393288.204012:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c04e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+8:13721:x1874217319637504:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787393288.204312:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c04e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+8:13721:x1874217319637504:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 296us (2677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393288.204322:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 80 00000100:00100000:1.0:1787393288.235093:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393288.235193:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319637632 00000100:00100000:0.0:1787393288.235204:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319637632 00000100:00100000:0.0:1787393288.235264:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 81 00000100:00100000:0.0:1787393288.235274:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+8:13721:x1874217319637632:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787393288.235576:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+8:13721:x1874217319637632:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 302us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393288.235588:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 81 00000100:00100000:1.0:1787393288.238762:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393288.238864:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319637760 00000100:00100000:2.0:1787393288.238874:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319637760 00000100:00100000:2.0:1787393288.238930:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 82 00000100:00100000:2.0:1787393288.238940:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+8:13702:x1874217319637760:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787393288.238956:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393288.238972:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8186b4600/0x19a927d9c62f2723 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0da40 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393288.238997:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8186b4600/0x19a927d9c62f2723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da40 expref: 9 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393288.239008:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8186b4600/0x19a927d9c62f2723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da40 expref: 9 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393288.239017:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4600, rc 0) 00000100:00100000:2.0:1787393288.239083:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+9:13702:x1874217319637760:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 145us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393288.239092:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 82 00000100:00100000:1.0:1787393288.245795:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393288.245898:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319637888 00000100:00100000:3.0:1787393288.245908:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319637888 00000100:00100000:3.0:1787393288.245964:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 83 00000100:00100000:3.0:1787393288.245973:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+9:13702:x1874217319637888:12345-192.168.203.21@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787393288.245997:0:14243:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787393288.246021:0:14243:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787393288.246025:0:14243:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787393288.246029:0:14243:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787393288.246031:0:14243:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787393288.256957:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+9:13702:x1874217319637888:12345-192.168.203.21@tcp:256:mount.lustre.0 Request processed in 10974us (11159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393288.256971:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 83 00000100:00100000:1.0:1787393288.265150:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393288.265255:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319638016 00000100:00100000:0.0:1787393288.265266:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319638016 00000100:00100000:0.0:1787393288.265323:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 84 00000100:00100000:0.0:1787393288.265334:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+9:13702:x1874217319638016:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787393288.265570:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393288.265592:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de82ffbf000/0x19a927d9c62f272a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0da47 expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393288.265622:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de82ffbf000/0x19a927d9c62f272a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da47 expref: 10 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393288.265634:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de82ffbf000/0x19a927d9c62f272a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da47 expref: 10 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393288.265643:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de82ffbf000, rc 0) 00000100:00100000:0.0:1787393288.265705:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+10:13702:x1874217319638016:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 373us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393288.265713:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 84 00000100:00100000:1.0:1787393288.268289:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393288.269223:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319638144 00000100:00100000:3.0:1787393288.269257:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319638144 00000100:00100000:3.0:1787393288.269322:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 85 00000100:00100000:3.0:1787393288.269333:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+10:13702:x1874217319638144:12345-192.168.203.21@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787393288.270017:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+10:13702:x1874217319638144:12345-192.168.203.21@tcp:501:mount.lustre.0 Request processed in 684us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393288.270025:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 85 00000100:00100000:1.0:1787393288.277165:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393288.277267:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319638272 00000100:00100000:0.0:1787393288.277276:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319638272 00000100:00100000:0.0:1787393288.277355:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 86 00000100:00100000:0.0:1787393288.277366:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+10:13702:x1874217319638272:12345-192.168.203.21@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787393288.277645:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+10:13702:x1874217319638272:12345-192.168.203.21@tcp:503:mount.lustre.0 Request processed in 280us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393288.277653:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 86 00000100:00100000:1.0:1787393288.284127:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393288.286553:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319638400 00000100:00100000:3.0:1787393288.286568:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319638400 00000100:00100000:3.0:1787393288.286678:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 87 00000100:00100000:3.0:1787393288.286688:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+10:13724:x1874217319638400:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787393288.286992:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+10:13724:x1874217319638400:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 305us (2882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393288.287000:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 87 00000100:00100000:1.0:1787393288.294256:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393288.297721:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319638528 00000100:00100000:2.0:1787393288.297736:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319638528 00000100:00100000:2.0:1787393288.297807:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 88 00000100:00100000:2.0:1787393288.297818:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+10:13724:x1874217319638528:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787393288.298097:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+10:13724:x1874217319638528:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 280us (3858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393288.298105:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 88 00000100:00100000:1.0:1787393288.313524:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393288.313990:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319638656 00000100:00100000:2.0:1787393288.314000:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319638656 00000100:00100000:2.0:1787393288.314049:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:2.0:1787393288.314058:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1874217319638656:12345-192.168.203.21@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787393288.314088:0:14249:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 7f99b078-55e6-49ce-aa7b-246ff01aefa1@192.168.203.21@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:2.0:1787393288.314144:0:14249:0:(genops.c:1406:class_connect()) connect: client 7f99b078-55e6-49ce-aa7b-246ff01aefa1, cookie 0x19a927d9c62f2731 00000004:00100000:2.0:1787393288.314171:0:14249:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787393288.314176:0:14249:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1787393288.394257:0:14249:0:(import.c:65:import_set_state_nolock()) ffff9de7012ae800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787393288.394340:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:2352:x1874217319638656:12345-192.168.203.21@tcp:38:mount.lustre.0 Request processed in 80280us (80823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393288.394351:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:1.0:1787393288.400236:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393288.400477:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319638912 00000100:00100000:0.0:1787393288.400488:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319638912 00000100:00100000:0.0:1787393288.400607:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:0.0:1787393288.400617:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:13702:x1874217319638912:12345-192.168.203.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787393288.400657:0:14250:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787393288.400743:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:13702:x1874217319638912:12345-192.168.203.21@tcp:41:mount.lustre.0 Request processed in 127us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393288.400751:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00080000:1.0:1787393288.401074:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393288.403698:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393288.403957:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319639040 00000100:00100000:1.0:1787393288.403968:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319639040 00000100:00100000:1.0:1787393288.404024:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:1.0:1787393288.404033:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:13702:x1874217319639040:12345-192.168.203.21@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787393288.404251:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:13702:x1874217319639040:12345-192.168.203.21@tcp:40:mount.lustre.0 Request processed in 218us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393288.404260:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:2.0:1787393288.410808:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393288.410880:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393288.410915:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393288.410940:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393288.411075:0:14886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319639168 00000100:00100000:1.0:1787393288.411086:0:14886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319639168 00000100:00100000:1.0:1787393288.411134:0:14886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319639296 00000100:00100000:1.0:1787393288.411137:0:14886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319639296 00000100:00100000:1.0:1787393288.411178:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:1.0:1787393288.411186:0:14886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1874217319639168:12345-192.168.203.21@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787393288.411217:0:14886:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7f99b078-55e6-49ce-aa7b-246ff01aefa1@192.168.203.21@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:1.0:1787393288.411258:0:14886:0:(genops.c:1406:class_connect()) connect: client 7f99b078-55e6-49ce-aa7b-246ff01aefa1, cookie 0x19a927d9c62f2738 00002000:00100000:1.0:1787393288.411271:0:14886:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7f99b078-55e6-49ce-aa7b-246ff01aefa1/ffff9de7012af800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787393288.411294:0:14886:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787393288.411636:0:14886:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787393288.411666:0:14886:0:(import.c:65:import_set_state_nolock()) ffff9de7012ad000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787393288.411739:0:14886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:2352:x1874217319639168:12345-192.168.203.21@tcp:8:mount.lustre.0 Request processed in 552us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393288.411747:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:2.0:1787393288.411765:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:2.0:1787393288.411774:0:14887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1874217319639296:12345-192.168.203.21@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787393288.411792:0:14887:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7f99b078-55e6-49ce-aa7b-246ff01aefa1@192.168.203.21@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:2.0:1787393288.411821:0:14887:0:(genops.c:1406:class_connect()) connect: client 7f99b078-55e6-49ce-aa7b-246ff01aefa1, cookie 0x19a927d9c62f273f 00002000:00100000:2.0:1787393288.411826:0:14887:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7f99b078-55e6-49ce-aa7b-246ff01aefa1/ffff9de81ea77000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787393288.411862:0:14887:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787393288.411957:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319638784 00000100:00100000:0.0:1787393288.411964:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319638784 00000100:00100000:0.0:1787393288.412003:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:0.0:1787393288.412011:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:0:x1874217319638784:12345-192.168.203.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787393288.412033:0:14250:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787393288.412072:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:0:x1874217319638784:12345-192.168.203.21@tcp:41:mount.lustre.0 Request processed in 63us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393288.412080:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00002000:00080000:2.0:1787393288.412177:0:14887:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787393288.412195:0:14887:0:(import.c:65:import_set_state_nolock()) ffff9de81ea71800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787393288.412221:0:14887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:2352:x1874217319639296:12345-192.168.203.21@tcp:8:mount.lustre.0 Request processed in 447us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393288.412229:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:3.0:1787393288.413198:0:14252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319639424 00000100:00100000:3.0:1787393288.413206:0:14252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319639424 00000100:00100000:3.0:1787393288.413258:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:3.0:1787393288.413266:0:14252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:13702:x1874217319639424:12345-192.168.203.21@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787393288.416081:0:14252:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2751us 00000004:00200000:3.0:1787393288.443171:0:14252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787393288.443359:0:14252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:13702:x1874217319639424:12345-192.168.203.21@tcp:33:mount.lustre.0 Request processed in 30088us (32473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393288.443818:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:1.0:1787393288.617157:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393288.617255:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319639552 00000100:00100000:3.0:1787393288.617265:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319639552 00000100:00100000:3.0:1787393288.617326:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:3.0:1787393288.617337:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:13745:x1874217319639552:12345-192.168.203.21@tcp:101:mkdir.0 00010000:00010000:3.0:1787393288.617648:0:14251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393288.617679:0:14251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030a00/0x19a927d9c62f2746 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0da71 expref: -99 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393288.617759:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f274d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393288.617772:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f274d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393288.617973:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f274d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393288.618168:0:14251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787393288.618172:0:14251:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787393288.618278:0:14251:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f274d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393288.618306:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030a00/0x19a927d9c62f2746 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da71 expref: 8 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393288.618323:0:14251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f274d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da71 expref: 7 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393288.618331:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de8063da400) 00010000:00010000:3.0:1787393288.618334:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787393288.618337:0:14251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de800031c00, rc 0) 00000100:00100000:3.0:1787393288.620113:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+7:13745:x1874217319639552:12345-192.168.203.21@tcp:101:mkdir.0 Request processed in 2767us (2956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393288.620124:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00010000:00010000:3.0:1787393288.875252:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787393289.896130:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393290.090713:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3326:1874217338503296:0@lo:400:kworker.0 00000100:00100000:3.0:1787393290.090741:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338503680:0@lo:400:kworker.0 00000100:00100000:2.0:1787393290.090815:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338503424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787393290.090880:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338503552:0@lo:400:kworker.0 00000100:00100000:3.0:1787393290.090981:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393290.091058:0:14886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338503680 00000100:00100000:3.0:1787393290.091065:0:14886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338503680 00000100:00100000:3.0:1787393290.091116:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787393290.091125:0:14886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338503680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393290.091175:0:14886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338503680:12345-0@lo:400:kworker.0 Request processed in 51us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393290.091182:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787393290.091216:0:3325:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787393290.091245:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338503680:0@lo:400:kworker.0 00000100:00080000:3.0:1787393290.091269:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787393290.096417:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393290.096492:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874217338503808:0@lo:400:kworker.0 00000100:00100000:1.0:1787393290.096556:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393290.096602:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338503808 00000100:00100000:1.0:1787393290.096609:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338503808 00000100:00100000:1.0:1787393290.096652:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787393290.096661:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1874217338503808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393290.096713:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1874217338503808:12345-0@lo:400:kworker.0 Request processed in 53us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393290.096720:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787393290.096766:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3326:1874217338503808:0@lo:400:kworker.0 00000100:00100000:3.0:1787393290.096790:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338503296 00000100:00100000:3.0:1787393290.096795:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338503296 00000100:00100000:3.0:1787393290.096827:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787393290.096865:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:3326:x1874217338503296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393290.096901:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:3326:x1874217338503296:12345-0@lo:400:kworker.0 Request processed in 38us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393290.096907:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787393290.097098:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3326:1874217338503296:0@lo:400:kworker.0 00000100:00100000:2.0:1787393290.097242:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393290.097271:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338503936:0@lo:400:kworker.0 00000100:00100000:2.0:1787393290.097294:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393290.097556:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393290.097590:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338504064:0@lo:400:kworker.0 00000100:00100000:0.0:1787393290.097624:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393290.097664:0:14887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338503552 00000100:00100000:2.0:1787393290.097668:0:14887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338503552 00000100:00100000:2.0:1787393290.097712:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787393290.097720:0:14887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338503552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393290.097768:0:14887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338503552:12345-0@lo:400:kworker.0 Request processed in 49us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393290.097775:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787393290.097792:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787393290.098380:0:14889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338503424 00000100:00100000:1.0:1787393290.098386:0:14889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338503424 00000100:00100000:0.0:1787393290.098531:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338503552:0@lo:400:kworker.0 00000100:00100000:3.0:1787393290.098631:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338503936 00000100:00100000:3.0:1787393290.098637:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338503936 00000100:00100000:3.0:1787393290.098673:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338504064 00000100:00100000:3.0:1787393290.098677:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338504064 00000100:00100000:3.0:1787393290.098696:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787393290.098703:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338503936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393290.099097:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787393290.099107:0:14889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338503424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787393290.099137:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787393290.099174:0:14889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338503424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393290.099180:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787393290.099283:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338503936:12345-0@lo:400:kworker.0 Request processed in 123us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393290.099291:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787393290.099308:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787393290.099315:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338504064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393290.099352:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338504064:12345-0@lo:400:kworker.0 Request processed in 39us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393290.099358:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787393290.099498:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393290.099536:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338503424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787393290.099548:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338503936:0@lo:400:kworker.0 00000100:00100000:0.0:1787393290.099707:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338504064:0@lo:400:kworker.0 00000100:00100000:2.0:1787393290.601214:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83c5a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338504192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787393290.601296:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393290.601372:0:14888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338504192 00000100:00100000:2.0:1787393290.601380:0:14888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338504192 00000100:00100000:2.0:1787393290.601425:0:14888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787393290.601434:0:14888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338504192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787393290.601478:0:14888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393290.601539:0:14888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338504192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393290.601547:0:14888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787393290.601589:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83c5a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338504192:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787393290.627864:0:7527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7f99b078-55e6-49ce-aa7b-246ff01aefa1 00010000:00010000:3.0:1787393290.920239:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393291.009320:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393291.009407:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319639680 00000100:00100000:3.0:1787393291.009417:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319639680 00000100:00100000:3.0:1787393291.009499:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:3.0:1787393291.009511:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+7:13798:x1874217319639680:12345-192.168.203.21@tcp:41:lfs.0 00000004:00000024:3.0:1787393291.009556:0:14251:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787393291.009640:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+7:13798:x1874217319639680:12345-192.168.203.21@tcp:41:lfs.0 Request processed in 131us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393291.009647:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00080000:2.0:1787393291.009977:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393291.016952:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393291.017010:0:14888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319639808 00000100:00100000:2.0:1787393291.017020:0:14888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319639808 00000100:00100000:2.0:1787393291.017081:0:14888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:2.0:1787393291.017088:0:14888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:13798:x1874217319639808:12345-192.168.203.21@tcp:13:lfs.0 00002000:00000024:2.0:1787393291.017110:0:14888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787393291.017181:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787393291.017247:0:14888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:13798:x1874217319639808:12345-192.168.203.21@tcp:13:lfs.0 Request processed in 158us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393291.017255:0:14888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:1.0:1787393291.025368:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393291.025479:0:14889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319639936 00000100:00100000:2.0:1787393291.025489:0:14889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319639936 00000100:00100000:2.0:1787393291.025564:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:2.0:1787393291.025574:0:14889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7f99b078-55e6-49ce-aa7b-246ff01aefa1+5:13798:x1874217319639936:12345-192.168.203.21@tcp:13:lfs.0 00002000:00000024:2.0:1787393291.025599:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393291.025681:0:14889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7f99b078-55e6-49ce-aa7b-246ff01aefa1+5:13798:x1874217319639936:12345-192.168.203.21@tcp:13:lfs.0 Request processed in 108us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393291.025689:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00080000:3.0:1787393291.026073:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787393291.315707:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393291.315924:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319640064 00000100:00100000:2.0:1787393291.315934:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319640064 00000100:00100000:2.0:1787393291.316018:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 90 00000100:00100000:2.0:1787393291.316040:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+10:13830:x1874217319640064:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787393291.316057:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393291.316075:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8186b5400/0x19a927d9c62f2754 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0da78 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393291.316104:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8186b5400/0x19a927d9c62f2754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da78 expref: 11 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393291.316115:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8186b5400/0x19a927d9c62f2754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da78 expref: 11 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393291.316124:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b5400, rc 0) 00000100:00100000:2.0:1787393291.317637:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+11:13830:x1874217319640064:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 1590us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393291.317649:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 90 00000100:00100000:1.0:1787393291.335190:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393291.335279:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319640192 00000100:00100000:3.0:1787393291.335290:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319640192 00000100:00100000:3.0:1787393291.335378:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 91 00000100:00100000:3.0:1787393291.335400:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+11:13830:x1874217319640192:12345-192.168.203.21@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787393291.336000:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+11:13830:x1874217319640192:12345-192.168.203.21@tcp:501:mount.lustre.0 Request processed in 599us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393291.336009:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 91 00000100:00100000:1.0:1787393291.352557:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393291.352797:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319640320 00000100:00100000:2.0:1787393291.352806:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319640320 00000100:00100000:2.0:1787393291.352888:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 92 00000100:00100000:2.0:1787393291.352899:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+11:13830:x1874217319640320:12345-192.168.203.21@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787393291.353193:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+11:13830:x1874217319640320:12345-192.168.203.21@tcp:503:mount.lustre.0 Request processed in 295us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393291.353201:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 92 00000100:00100000:0.0:1787393291.383190:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393291.383343:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319640448 00000100:00100000:1.0:1787393291.383362:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319640448 00000100:00100000:1.0:1787393291.383425:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 93 00000100:00100000:1.0:1787393291.383435:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+11:13837:x1874217319640448:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787393291.384053:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+11:13837:x1874217319640448:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 616us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393291.384062:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 93 00000100:00100000:1.0:1787393291.419199:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393291.420619:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319640576 00000100:00100000:3.0:1787393291.420631:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319640576 00000100:00100000:2.0:1787393291.434270:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 94 00000100:00100000:2.0:1787393291.434291:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+11:13837:x1874217319640576:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787393291.434580:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+11:13837:x1874217319640576:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 296us (15387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393291.434598:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 94 00000100:00100000:3.0:1787393291.450315:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393291.450686:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319640704 00000100:00100000:1.0:1787393291.450696:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319640704 00000100:00100000:1.0:1787393291.450767:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 95 00000100:00100000:1.0:1787393291.450778:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+11:13830:x1874217319640704:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787393291.450794:0:14243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393291.450812:0:14243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8040d9c00/0x19a927d9c62f275b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0daa2 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393291.450905:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8040d9c00/0x19a927d9c62f275b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0daa2 expref: 12 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393291.450916:0:14243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8040d9c00/0x19a927d9c62f275b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0daa2 expref: 12 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393291.450925:0:14243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d9c00, rc 0) 00000100:00100000:1.0:1787393291.450981:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+12:13830:x1874217319640704:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 204us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393291.450988:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 95 00000100:00100000:0.0:1787393291.459278:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393291.459388:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319640832 00000100:00100000:2.0:1787393291.459398:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319640832 00000100:00100000:2.0:1787393291.459453:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 96 00000100:00100000:2.0:1787393291.459463:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f77fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+12:13830:x1874217319640832:12345-192.168.203.21@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787393291.459488:0:14244:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787393291.459510:0:14244:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787393291.459514:0:14244:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787393291.459517:0:14244:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787393291.459519:0:14244:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787393291.468799:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f77fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+12:13830:x1874217319640832:12345-192.168.203.21@tcp:256:mount.lustre.0 Request processed in 9326us (9517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393291.468812:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 96 00000100:00100000:3.0:1787393291.476239:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393291.476323:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319640960 00000100:00100000:2.0:1787393291.476332:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319640960 00000100:00100000:2.0:1787393291.476391:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 97 00000100:00100000:2.0:1787393291.476402:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f77f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+12:13830:x1874217319640960:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787393291.476419:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393291.476438:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8186b4a00/0x19a927d9c62f2762 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0daa9 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393291.476465:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8186b4a00/0x19a927d9c62f2762 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0daa9 expref: 13 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393291.476477:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8186b4a00/0x19a927d9c62f2762 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0daa9 expref: 13 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393291.476503:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4a00, rc 0) 00000100:00100000:2.0:1787393291.476761:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f77f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:13830:x1874217319640960:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 360us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393291.476769:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 97 00000100:00100000:0.0:1787393291.486771:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393291.487250:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319641088 00000100:00100000:2.0:1787393291.487261:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319641088 00000100:00100000:2.0:1787393291.487317:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 98 00000100:00100000:2.0:1787393291.487326:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f77cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:13830:x1874217319641088:12345-192.168.203.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787393291.487751:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f77cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:13830:x1874217319641088:12345-192.168.203.21@tcp:501:mount.lustre.0 Request processed in 423us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393291.487760:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 98 00000100:00100000:3.0:1787393291.495392:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393291.498702:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319641216 00000100:00100000:2.0:1787393291.498719:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319641216 00000100:00100000:2.0:1787393291.498794:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 99 00000100:00100000:2.0:1787393291.498805:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f77d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:13830:x1874217319641216:12345-192.168.203.21@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787393291.499139:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f77d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:13830:x1874217319641216:12345-192.168.203.21@tcp:503:mount.lustre.0 Request processed in 334us (3754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393291.499148:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 99 00000100:00100000:3.0:1787393291.508005:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393291.508393:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319641344 00000100:00100000:1.0:1787393291.508404:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319641344 00000100:00100000:1.0:1787393291.508463:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 100 00000100:00100000:1.0:1787393291.508472:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f77c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:13842:x1874217319641344:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787393291.508777:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f77c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:13842:x1874217319641344:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 305us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393291.508786:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 100 00000100:00100000:1.0:1787393291.532582:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393291.532683:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319641472 00000100:00100000:0.0:1787393291.532693:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319641472 00000100:00100000:0.0:1787393291.532751:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 101 00000100:00100000:0.0:1787393291.532762:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de802df3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:13842:x1874217319641472:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787393291.533036:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de802df3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:13842:x1874217319641472:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 276us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393291.533045:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 101 00000100:00100000:3.0:1787393291.540083:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393291.541215:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319641600 00000100:00100000:0.0:1787393291.541235:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319641600 00000100:00100000:0.0:1787393291.541290:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:0.0:1787393291.541299:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1874217319641600:12345-192.168.203.21@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787393291.541331:0:14249:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from c97c6862-5e64-402f-825d-1f36dc9c809c@192.168.203.21@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:0.0:1787393291.541381:0:14249:0:(genops.c:1406:class_connect()) connect: client c97c6862-5e64-402f-825d-1f36dc9c809c, cookie 0x19a927d9c62f2769 00000004:00100000:0.0:1787393291.541412:0:14249:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787393291.541533:0:14249:0:(import.c:65:import_set_state_nolock()) ffff9de80bb71000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787393291.541614:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+6:2352:x1874217319641600:12345-192.168.203.21@tcp:38:mount.lustre.0 Request processed in 314us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393291.541638:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:3.0:1787393291.578522:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393291.578684:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319641728 00000100:00100000:2.0:1787393291.578694:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319641728 00000100:00100000:2.0:1787393291.578770:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:2.0:1787393291.578781:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c97c6862-5e64-402f-825d-1f36dc9c809c+6:0:x1874217319641728:12345-192.168.203.21@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787393291.578811:0:14251:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787393291.578907:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c97c6862-5e64-402f-825d-1f36dc9c809c+6:0:x1874217319641728:12345-192.168.203.21@tcp:41:mount.lustre.0 Request processed in 126us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393291.578928:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00080000:3.0:1787393291.579310:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787393291.579436:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393291.579747:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319641856 00000100:00100000:3.0:1787393291.579753:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319641856 00000100:00100000:3.0:1787393291.579791:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:3.0:1787393291.579799:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c97c6862-5e64-402f-825d-1f36dc9c809c+6:13830:x1874217319641856:12345-192.168.203.21@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787393291.579815:0:14250:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787393291.579879:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c97c6862-5e64-402f-825d-1f36dc9c809c+6:13830:x1874217319641856:12345-192.168.203.21@tcp:41:mount.lustre.0 Request processed in 80us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393291.579886:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:1.0:1787393291.582036:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393291.582115:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319641984 00000100:00100000:0.0:1787393291.582124:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319641984 00000100:00100000:0.0:1787393291.582173:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:0.0:1787393291.582182:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+6:13830:x1874217319641984:12345-192.168.203.21@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787393291.582265:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+6:13830:x1874217319641984:12345-192.168.203.21@tcp:40:mount.lustre.0 Request processed in 83us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393291.582272:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:2.0:1787393291.594168:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393291.594210:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393291.594254:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393291.594345:0:14253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319642368 00000100:00100000:3.0:1787393291.594365:0:14253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319642368 00000100:00100000:3.0:1787393291.594418:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:3.0:1787393291.594432:0:14253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c97c6862-5e64-402f-825d-1f36dc9c809c+6:13830:x1874217319642368:12345-192.168.203.21@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787393291.594738:0:14253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787393291.594912:0:14253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c97c6862-5e64-402f-825d-1f36dc9c809c+6:13830:x1874217319642368:12345-192.168.203.21@tcp:33:mount.lustre.0 Request processed in 483us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393291.594921:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:0.0:1787393291.594994:0:14887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319642112 00000100:00100000:0.0:1787393291.594999:0:14887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319642112 00000100:00100000:0.0:1787393291.595027:0:14887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319642240 00000100:00100000:0.0:1787393291.595030:0:14887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319642240 00000100:00100000:0.0:1787393291.595042:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:0.0:1787393291.595047:0:14887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1874217319642112:12345-192.168.203.21@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787393291.595069:0:14887:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from c97c6862-5e64-402f-825d-1f36dc9c809c@192.168.203.21@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:0.0:1787393291.595098:0:14887:0:(genops.c:1406:class_connect()) connect: client c97c6862-5e64-402f-825d-1f36dc9c809c, cookie 0x19a927d9c62f2770 00002000:00100000:0.0:1787393291.595109:0:14887:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c97c6862-5e64-402f-825d-1f36dc9c809c/ffff9de80bb74800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787393291.595119:0:14887:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787393291.595205:0:14887:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787393291.595242:0:14887:0:(import.c:65:import_set_state_nolock()) ffff9de80bb75000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787393291.595273:0:14887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c97c6862-5e64-402f-825d-1f36dc9c809c+6:2352:x1874217319642112:12345-192.168.203.21@tcp:8:mount.lustre.0 Request processed in 224us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393291.595280:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:0.0:1787393291.595293:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:0.0:1787393291.595298:0:14887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1874217319642240:12345-192.168.203.21@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787393291.595319:0:14887:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from c97c6862-5e64-402f-825d-1f36dc9c809c@192.168.203.21@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:0.0:1787393291.595335:0:14887:0:(genops.c:1406:class_connect()) connect: client c97c6862-5e64-402f-825d-1f36dc9c809c, cookie 0x19a927d9c62f2777 00002000:00100000:0.0:1787393291.595340:0:14887:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c97c6862-5e64-402f-825d-1f36dc9c809c/ffff9de80bb71800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787393291.595347:0:14887:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787393291.595490:0:14887:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787393291.595504:0:14887:0:(import.c:65:import_set_state_nolock()) ffff9de80bb70800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787393291.595528:0:14887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c97c6862-5e64-402f-825d-1f36dc9c809c+6:2352:x1874217319642240:12345-192.168.203.21@tcp:8:mount.lustre.0 Request processed in 228us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393291.595535:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000001:00100000:0.0:1787393291.681795:0:6648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c97c6862-5e64-402f-825d-1f36dc9c809c 00000001:00100000:0.0:1787393291.681835:0:6648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7f99b078-55e6-49ce-aa7b-246ff01aefa1 00000100:00100000:1.0:1787393291.942789:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393291.942886:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319642496 00000100:00100000:0.0:1787393291.942896:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319642496 00000100:00100000:0.0:1787393291.942952:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:0.0:1787393291.942961:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c97c6862-5e64-402f-825d-1f36dc9c809c+6:13863:x1874217319642496:12345-192.168.203.21@tcp:101:mkdir.0 00010000:00010000:0.0:1787393291.942980:0:14251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393291.942999:0:14251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe800/0x19a927d9c62f277e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0dad3 expref: -99 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393291.943055:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2785 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393291.943067:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393291.943079:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393291.943372:0:14251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787393291.943377:0:14251:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787393291.943524:0:14251:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393291.943550:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe800/0x19a927d9c62f277e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0dad3 expref: 8 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393291.943568:0:14251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2785 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0dad3 expref: 7 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393291.943582:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de8063da400) 00010000:00010000:0.0:1787393291.943585:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787393291.943588:0:14251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de82ffbf200, rc 0) 00000100:00100000:0.0:1787393291.943816:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c97c6862-5e64-402f-825d-1f36dc9c809c+7:13863:x1874217319642496:12345-192.168.203.21@tcp:101:mkdir.0 Request processed in 855us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393291.943824:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 14 00010000:00010000:3.0:1787393291.944889:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787393292.522338:0:14283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787393292.979600:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787393293.769003:0:5842:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c97c6862-5e64-402f-825d-1f36dc9c809c 00000001:00100000:1.0:1787393293.769024:0:5842:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7f99b078-55e6-49ce-aa7b-246ff01aefa1 00010000:00010000:3.0:1787393293.992144:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393295.017022:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787393295.065749:0:16113:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1787393295.210324:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787393295.210348:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338504320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787393295.210414:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393295.214578:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338504576:0@lo:400:kworker.0 00000100:00100000:1.0:1787393295.214657:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393295.214691:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787393295.214696:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338504704:0@lo:400:kworker.0 00000100:00100000:1.0:1787393295.214718:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393295.214750:0:14887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338504576 00000100:00100000:1.0:1787393295.214757:0:14887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338504576 00000100:00100000:1.0:1787393295.214804:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787393295.214814:0:14887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338504576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393295.214879:0:14887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338504576:12345-0@lo:400:kworker.0 Request processed in 66us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393295.214887:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787393295.214910:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338504832:0@lo:400:kworker.0 00000100:00100000:1.0:1787393295.214934:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393295.214960:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787393295.214965:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3326:1874217338504448:0@lo:400:kworker.0 00000100:00100000:1.0:1787393295.214991:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393295.215015:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83532ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3326:1874217338504960:0@lo:400:kworker.0 00000100:00100000:1.0:1787393295.215035:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393295.215057:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338504704 00000100:00100000:1.0:1787393295.215060:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338504704 00000100:00100000:1.0:1787393295.215076:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338504832 00000100:00100000:1.0:1787393295.215078:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338504832 00000100:00100000:1.0:1787393295.215087:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338504960 00000100:00100000:1.0:1787393295.215089:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338504960 00000100:00100000:1.0:1787393295.215100:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787393295.215105:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338504704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393295.215130:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1874217338504704:12345-0@lo:400:kworker.0 Request processed in 25us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393295.215142:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787393295.215152:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787393295.215157:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338504832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393295.215181:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1874217338504832:12345-0@lo:400:kworker.0 Request processed in 24us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393295.215186:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787393295.215206:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787393295.215211:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1874217338504960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393295.215232:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1874217338504960:12345-0@lo:400:kworker.0 Request processed in 21us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393295.215236:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787393295.215250:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338504448 00000100:00100000:1.0:1787393295.215253:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338504448 00000100:00100000:1.0:1787393295.215272:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787393295.215277:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de802df2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:3326:x1874217338504448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393295.215298:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de802df2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:3326:x1874217338504448:12345-0@lo:400:kworker.0 Request processed in 21us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393295.215304:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787393295.215344:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3326:1874217338504448:0@lo:400:kworker.0 00000100:00100000:1.0:1787393295.215357:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83532ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3326:1874217338504960:0@lo:400:kworker.0 00000100:00100000:1.0:1787393295.215366:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1874217338504832:0@lo:400:kworker.0 00000100:00100000:1.0:1787393295.215400:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1874217338504704:0@lo:400:kworker.0 00000100:00100000:1.0:1787393295.215409:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338504576:0@lo:400:kworker.0 00000100:00100000:3.0:1787393295.215727:0:14889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338504320 00000100:00100000:3.0:1787393295.215731:0:14889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338504320 00000100:00100000:3.0:1787393295.215769:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787393295.215777:0:14889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338504320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787393295.215801:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787393295.215865:0:14889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338504320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (5451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393295.215872:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787393295.215893:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787393295.215897:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787393295.215899:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787393295.215926:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338504320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787393295.720200:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338505088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787393295.720268:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393295.720461:0:14889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338505088 00000100:00100000:2.0:1787393295.720469:0:14889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338505088 00000100:00100000:2.0:1787393295.720515:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787393295.720524:0:14889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83532ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338505088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787393295.720556:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393295.720610:0:14889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83532ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338505088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393295.720617:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787393295.720894:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338505088:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787393295.862521:0:7527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c97c6862-5e64-402f-825d-1f36dc9c809c 00010000:00010000:3.0:1787393296.040069:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393296.730623:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393296.730663:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393296.730687:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393296.730705:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393296.730724:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393296.730744:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393296.730768:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393296.730791:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319642752 00000100:00100000:1.0:1787393296.730800:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319642752 00000100:00100000:1.0:1787393296.730879:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319643136 00000100:00100000:1.0:1787393296.730883:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319643136 00000100:00100000:1.0:1787393296.730906:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:1.0:1787393296.730914:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:2356:x1874217319642752:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393296.730985:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:2356:x1874217319642752:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 71us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393296.730993:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:1.0:1787393296.731010:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:1.0:1787393296.731017:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+6:2355:x1874217319643136:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393296.731045:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+6:2355:x1874217319643136:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393296.731051:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:1.0:1787393296.731070:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319642624 00000100:00100000:1.0:1787393296.731080:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319642624 00000100:00100000:1.0:1787393296.731108:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 103 00000100:00100000:1.0:1787393296.731115:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:2355:x1874217319642624:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393296.731142:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:2355:x1874217319642624:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 28us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393296.731148:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 103 00000100:00100000:1.0:1787393296.731174:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319643008 00000100:00100000:1.0:1787393296.731177:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319643008 00000100:00100000:1.0:1787393296.732651:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319643264 00000100:00100000:1.0:1787393296.732660:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319643264 00000100:00100000:1.0:1787393296.732681:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319642880 00000100:00100000:1.0:1787393296.732684:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319642880 00000100:00100000:1.0:1787393296.732698:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319643392 00000100:00100000:1.0:1787393296.732701:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319643392 00000100:00100000:1.0:1787393296.732722:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:1.0:1787393296.732730:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+5:2356:x1874217319643008:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393296.732779:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+5:2356:x1874217319643008:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 50us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393296.732787:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:1.0:1787393296.732802:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:1.0:1787393296.732808:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+5:2356:x1874217319643264:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393296.732830:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+5:2356:x1874217319643264:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 23us (2125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393296.732835:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:1.0:1787393296.732864:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:1.0:1787393296.732871:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+5:2355:x1874217319642880:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787393296.732912:0:14886:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787393296.732913:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+5:2355:x1874217319642880:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 43us (2188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393296.732926:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:0.0:1787393296.732926:0:14886:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787393296.732945:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:0.0:1787393296.732949:0:14887:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787393296.732954:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+5:2355:x1874217319643392:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393296.733383:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+5:2355:x1874217319643392:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 429us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393296.733391:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00080000:1.0:1787393296.733410:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787393296.733415:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787393296.733419:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787393297.066679:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787393298.098662:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787393298.479770:0:16264:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc521ba190 00000020:00000080:2.0:1787393298.479785:0:16264:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787393298.479790:0:16264:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787393298.479796:0:16264:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc521bc420 20000000:00000080:2.0:1787393298.479803:0:16264:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9de83ba4d400 uarg=0000000000000000 20000000:01000000:2.0:1787393298.480282:0:16264:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787393298.480288:0:16264:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787393298.480293:0:16264:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787393298.481189:0:16265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787393298.481357:0:16264:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787393298.491957:0:16264:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787393298.492125:0:16264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9de82ffbe000/0x19a927d9c62f278c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393298.492145:0:16264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de80761d800/0x19a927d9c62f2483 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f247c expref: 18 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393298.492166:0:16264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de80761d400/0x19a927d9c62f24d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f24c9 expref: 18 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393298.492183:0:16264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de800031a00/0x19a927d9c62f2604 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f25fd expref: 18 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393298.492242:0:16264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de82ffbf000/0x19a927d9c62f272a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da47 expref: 12 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393298.492251:0:16264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9de8186b4a00/0x19a927d9c62f2762 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0daa9 expref: 12 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393298.492258:0:16264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9de82ffbe000/0x19a927d9c62f278c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393298.492296:0:16264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de8186b4a00/0x19a927d9c62f2762 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0daa9 expref: 12 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393298.492309:0:16264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de8186b4a00/0x19a927d9c62f2762 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0daa9 expref: 12 pid: 14242 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393298.492325:0:16264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835255880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16264:1874217338505216:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787393298.492433:0:16264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de82ffbf000/0x19a927d9c62f272a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da47 expref: 12 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393298.492442:0:16264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de82ffbf000/0x19a927d9c62f272a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da47 expref: 12 pid: 14244 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393298.492452:0:16264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835257800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16264:1874217338505344:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787393298.492494:0:16264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de800031a00/0x19a927d9c62f2604 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f25fd expref: 18 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393298.492503:0:16264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de800031a00/0x19a927d9c62f2604 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f25fd expref: 18 pid: 14244 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393298.492512:0:16264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835255180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16264:1874217338505472:0@lo:104: 00000100:00100000:0.0:1787393298.492551:0:16264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787393298.492592:0:16264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de80761d400/0x19a927d9c62f24d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f24c9 expref: 18 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393298.492599:0:16264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de80761d400/0x19a927d9c62f24d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f24c9 expref: 18 pid: 14242 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393298.492608:0:16264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835256a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16264:1874217338505600:0@lo:104: 00000100:00100000:0.0:1787393298.492628:0:16264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787393298.492658:0:16264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9de80761d800/0x19a927d9c62f2483 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19a927d9c62f247c expref: 18 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393298.492665:0:16264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9de80761d800/0x19a927d9c62f2483 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19a927d9c62f247c expref: 18 pid: 14243 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393298.492673:0:16264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835254e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16264:1874217338505728:0@lo:104: 00000100:00100000:0.0:1787393298.492694:0:16264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393298.492704:0:16264:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80b036180 going to sleep for 11 seconds 00000100:00100000:1.0:1787393298.492831:0:14232:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787393298.492872:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338505472 00000100:00100000:1.0:1787393298.492879:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338505472 00000100:00100000:1.0:1787393298.492914:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338505600 00000100:00100000:1.0:1787393298.492917:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338505600 00000100:00100000:1.0:1787393298.492927:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338505728 00000100:00100000:1.0:1787393298.492929:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338505728 00000100:00100000:1.0:1787393298.492941:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787393298.492948:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835255c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+5:16264:x1874217338505472:12345-0@lo:104: 00010000:00010000:1.0:1787393298.492959:0:14232:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de8186b5600/0x19a927d9c62f25fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f2604 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.493014:0:14232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787393298.493020:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835255c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+5:16264:x1874217338505472:12345-0@lo:104: Request processed in 72us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393298.493037:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787393298.493053:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787393298.493059:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835254700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+4:16264:x1874217338505600:12345-0@lo:104: 00010000:00010000:1.0:1787393298.493066:0:14232:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de8186b4800/0x19a927d9c62f24c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f24d0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.493575:0:14232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787393298.493582:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835254700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+4:16264:x1874217338505600:12345-0@lo:104: Request processed in 523us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393298.493590:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787393298.493605:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787393298.493611:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de7012b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+3:16264:x1874217338505728:12345-0@lo:104: 00010000:00010000:1.0:1787393298.493619:0:14232:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f247c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f2483 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.493645:0:14232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787393298.493650:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de7012b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+3:16264:x1874217338505728:12345-0@lo:104: Request processed in 40us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393298.493656:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787393298.493696:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787393298.493702:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8186b5600/0x19a927d9c62f25fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f2604 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.493709:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5600 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1787393298.493713:0:14237:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8186b5600/0x19a927d9c62f25fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f2604 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.493733:0:14237:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8186b5600/0x19a927d9c62f25fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f2604 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393298.493740:0:14237:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8186b5600/0x19a927d9c62f25fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f2604 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393298.493746:0:14237:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787393298.493775:0:14237:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8186b5600/0x19a927d9c62f25fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2604 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.493782:0:14237:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787393298.493802:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8186b5600/0x19a927d9c62f25fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2604 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.493809:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8186b5600/0x19a927d9c62f25fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2604 expref: -99 pid: 15553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.493821:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787393298.493824:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8186b4800/0x19a927d9c62f24c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f24d0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.493829:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4800 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1787393298.493832:0:14237:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8186b4800/0x19a927d9c62f24c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f24d0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.493860:0:14237:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8186b4800/0x19a927d9c62f24c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f24d0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393298.493867:0:14237:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8186b4800/0x19a927d9c62f24c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f24d0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393298.493878:0:14237:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787393298.493893:0:14237:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8186b4800/0x19a927d9c62f24c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f24d0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.493898:0:14237:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787393298.493913:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8186b4800/0x19a927d9c62f24c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f24d0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.493920:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8186b4800/0x19a927d9c62f24c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f24d0 expref: -99 pid: 14883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.493928:0:14237:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787393298.493931:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f247c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19a927d9c62f2483 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.493937:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5200 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1787393298.493940:0:14237:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f247c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19a927d9c62f2483 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.493945:0:14237:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f247c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19a927d9c62f2483 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787393298.493951:0:14237:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f247c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19a927d9c62f2483 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787393298.493955:0:14237:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787393298.493967:0:14237:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f247c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2483 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.493972:0:14237:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787393298.493985:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f247c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2483 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.493991:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f247c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19a927d9c62f2483 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.494003:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393298.494005:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787393298.494006:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393298.494027:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3325:1874217338505856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787393298.494057:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393298.494106:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3326:1874217338505984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787393298.494129:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393298.494147:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787393298.494152:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3326:1874217338506112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787393298.494181:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393298.494462:0:16264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835255180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16264:1874217338505472:0@lo:104: 00000100:00100000:0.0:1787393298.494470:0:16264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835256a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16264:1874217338505600:0@lo:104: 00000100:00100000:0.0:1787393298.494477:0:16264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835254e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16264:1874217338505728:0@lo:104: 00010000:00010000:2.0:1787393298.494537:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787393298.494658:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338505856 00000100:00100000:1.0:1787393298.494663:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338505856 00010000:00010000:1.0:1787393298.494686:0:14236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de800031a00/0x19a927d9c62f2604 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f25fd expref: 19 pid: 14244 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393298.494702:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338505984 00000100:00100000:1.0:1787393298.494705:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338505984 00010000:00010000:1.0:1787393298.494714:0:14236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de80761d400/0x19a927d9c62f24d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f24c9 expref: 20 pid: 14242 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393298.494722:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338506112 00000100:00100000:1.0:1787393298.494723:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338506112 00010000:00010000:1.0:1787393298.494733:0:14236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de80761d800/0x19a927d9c62f2483 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f247c expref: 21 pid: 14243 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393298.494755:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787393298.494762:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+21:3325:x1874217338505856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787393298.494773:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393298.494778:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de800031a00/0x19a927d9c62f2604 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f25fd expref: 21 pid: 14244 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.494787:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de800031a00/0x19a927d9c62f2604 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f25fd expref: 21 pid: 14244 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.494801:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de800031a00/0x19a927d9c62f2604 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f25fd expref: 21 pid: 14244 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.494815:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393298.494872:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+20:3325:x1874217338505856:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393298.494879:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787393298.494893:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787393298.494899:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:3326:x1874217338505984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787393298.494907:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393298.494911:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de80761d400/0x19a927d9c62f24d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f24c9 expref: 19 pid: 14242 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.494919:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de80761d400/0x19a927d9c62f24d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f24c9 expref: 19 pid: 14242 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.494928:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80761d400/0x19a927d9c62f24d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f24c9 expref: 19 pid: 14242 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.494946:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393298.494976:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:3326:x1874217338505984:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393298.494982:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787393298.494994:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787393298.495000:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81871ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:3326:x1874217338506112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787393298.495007:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393298.495011:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de80761d800/0x19a927d9c62f2483 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19a927d9c62f247c expref: 17 pid: 14243 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.495019:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de80761d800/0x19a927d9c62f2483 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19a927d9c62f247c expref: 17 pid: 14243 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.495028:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de80761d800/0x19a927d9c62f2483 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19a927d9c62f247c expref: 17 pid: 14243 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393298.495036:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393298.495057:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81871ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:3326:x1874217338506112:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393298.495063:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787393298.495321:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3325:1874217338505856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787393298.495439:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3326:1874217338506112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787393298.495448:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3326:1874217338505984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787393298.516270:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393298.516311:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393298.516436:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319643648 00000100:00100000:2.0:1787393298.516446:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319643648 00010000:00010000:2.0:1787393298.516483:0:14236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de82ffbf000/0x19a927d9c62f272a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da47 expref: 13 pid: 14244 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393298.516518:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319643520 00000100:00100000:2.0:1787393298.516522:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319643520 00010000:00010000:2.0:1787393298.516534:0:14236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9de8186b4a00/0x19a927d9c62f2762 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0daa9 expref: 14 pid: 14242 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393298.516549:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:2.0:1787393298.516557:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+14:2355:x1874217319643648:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393298.516572:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393298.516578:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de82ffbf000/0x19a927d9c62f272a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da47 expref: 14 pid: 14244 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393298.516589:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de82ffbf000/0x19a927d9c62f272a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da47 expref: 14 pid: 14244 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393298.516606:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393298.516652:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+14:2355:x1874217319643648:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 96us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393298.516659:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:2.0:1787393298.516676:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:2.0:1787393298.516682:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:2356:x1874217319643520:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787393298.516706:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393298.516710:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9de8186b4a00/0x19a927d9c62f2762 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0daa9 expref: 13 pid: 14242 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393298.516720:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9de8186b4a00/0x19a927d9c62f2762 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0daa9 expref: 13 pid: 14242 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393298.516732:0:14236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9de82ffbe000/0x19a927d9c62f278c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393298.516741:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de82ffbe000/0x19a927d9c62f278c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393298.516756:0:14236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de82ffbe000/0x19a927d9c62f278c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393298.516763:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9de82ffbe000/0x19a927d9c62f278c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393298.516769:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9de82ffbe000/0x19a927d9c62f278c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393298.516776:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9de82ffbe000/0x19a927d9c62f278c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393298.516781:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbe000 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393298.516785:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9de82ffbe000/0x19a927d9c62f278c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393298.516792:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9de82ffbe000/0x19a927d9c62f278c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393298.516810:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9de82ffbe000/0x19a927d9c62f278c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393298.516820:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787393298.516878:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:2356:x1874217319643520:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 193us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393298.516884:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00010000:00010000:0.0:1787393298.518127:0:16264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de8186b4a00/0x19a927d9c62f2762 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0daa9 expref: 12 pid: 14242 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393298.518154:0:16264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835255880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16264:1874217338505216:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787393298.518180:0:16264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de82ffbf000/0x19a927d9c62f272a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da47 expref: 11 pid: 14244 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393298.518189:0:16264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835257800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16264:1874217338505344:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787393298.518221:0:16264:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9de82ffbe000/0x19a927d9c62f278c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393298.518231:0:16264:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9de82ffbe000/0x19a927d9c62f278c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393298.518237:0:16264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9de82ffbe000/0x19a927d9c62f278c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393298.518243:0:16264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9de82ffbe000/0x19a927d9c62f278c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393299.121074:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393299.740816:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393299.740988:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319643776 00000100:00100000:1.0:1787393299.740999:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319643776 00000100:00100000:1.0:1787393299.741064:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 104 00000100:00100000:1.0:1787393299.741074:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e87b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+11:13716:x1874217319643776:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787393299.741090:0:14244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393299.741116:0:14244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f2793 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0dada expref: -99 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393299.741142:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f2793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0dada expref: 12 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393299.741154:0:14244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8040d8400/0x19a927d9c62f2793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0dada expref: 12 pid: 14244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393299.741174:0:14244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d8400, rc 0) 00000100:00100000:1.0:1787393299.741243:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e87b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+12:13716:x1874217319643776:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 171us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393299.741251:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 104 00000100:00100000:1.0:1787393299.746026:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393299.746307:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319643904 00000100:00100000:3.0:1787393299.746317:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319643904 00000100:00100000:3.0:1787393299.746363:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 105 00000100:00100000:3.0:1787393299.746371:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e87bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+12:13716:x1874217319643904:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787393299.746627:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e87bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+12:13716:x1874217319643904:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 255us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393299.748502:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 105 00000100:00100000:0.0:1787393299.756657:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393299.756823:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319644032 00000100:00100000:3.0:1787393299.756833:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319644032 00000100:00100000:3.0:1787393299.757053:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 106 00000100:00100000:3.0:1787393299.757062:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+12:13716:x1874217319644032:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787393299.757543:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+12:13716:x1874217319644032:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 Request processed in 480us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393299.757551:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 106 00000100:00100000:0.0:1787393299.783026:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393299.783465:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319644160 00000100:00100000:2.0:1787393299.783476:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319644160 00000100:00100000:2.0:1787393299.783525:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 107 00000100:00100000:2.0:1787393299.783534:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e87ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+12:13716:x1874217319644160:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787393299.783551:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393299.783567:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8186b4a00/0x19a927d9c62f279a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0dae1 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393299.783595:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8186b4a00/0x19a927d9c62f279a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0dae1 expref: 13 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393299.783605:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8186b4a00/0x19a927d9c62f279a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0dae1 expref: 13 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393299.783614:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4a00, rc 0) 00000100:00100000:3.0:1787393299.785066:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e87ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:13716:x1874217319644160:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 1524us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393299.785078:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 107 00000100:00100000:3.0:1787393299.790998:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393299.791091:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319644288 00000100:00100000:0.0:1787393299.791106:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319644288 00000100:00100000:0.0:1787393299.791175:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 108 00000100:00100000:0.0:1787393299.791185:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e87a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:13716:x1874217319644288:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787393299.791463:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e87a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:13716:x1874217319644288:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 278us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393299.791471:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 108 00000100:00100000:1.0:1787393299.803830:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393299.807295:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319644416 00000100:00100000:3.0:1787393299.807311:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319644416 00000100:00100000:3.0:1787393299.807373:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 109 00000100:00100000:3.0:1787393299.807384:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e87a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:13716:x1874217319644416:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787393299.807604:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e87a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:13716:x1874217319644416:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 Request processed in 221us (3779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393299.807614:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 109 10000000:01000000:1.0:1787393299.880941:0:14246:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787393299.880950:0:14246:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de81e809000 from 10 10000000:01000000:1.0:1787393299.880955:0:14246:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787393299.880996:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f27a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393299.881008:0:14246:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f27a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393299.881020:0:14246:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f27a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393299.881055:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338506240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787393299.881118:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393299.881173:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818104300 going to sleep for 11 seconds 00000100:00100000:0.0:1787393299.881347:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338506240 00000100:00100000:0.0:1787393299.881355:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338506240 00000100:00100000:0.0:1787393299.881413:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787393299.881423:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+16:14246:x1874217338506240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787393299.881435:0:14243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393299.881447:0:14243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f27a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f27a1 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393299.881470:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f27a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f27a1 expref: 17 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393299.881481:0:14243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de82ffbfc00/0x19a927d9c62f27a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f27a1 expref: 17 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393299.881489:0:14243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de82ffbfc00, rc 0) 00000100:00100000:0.0:1787393299.881538:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:14246:x1874217338506240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393299.881545:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787393299.881773:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338506240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787393299.881787:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f27a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f27a8 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393299.881807:0:14246:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f27a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f27a8 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393299.881886:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338506368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787393299.881926:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393299.881947:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de81817ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787393299.882057:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338506368 00000100:00100000:1.0:1787393299.882061:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338506368 00000100:00100000:1.0:1787393299.882096:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787393299.882104:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e87b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:14246:x1874217338506368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393299.882366:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e87b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:14246:x1874217338506368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393299.882373:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787393299.882596:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338506368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787393299.882625:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338506496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787393299.882674:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393299.882694:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de81817ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787393299.882788:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338506496 00000100:00100000:1.0:1787393299.882793:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338506496 00000100:00100000:1.0:1787393299.882823:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787393299.882831:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:14246:x1874217338506496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787393299.883124:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:14246:x1874217338506496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 293us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393299.883132:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787393299.883271:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338506496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787393299.884591:0:16317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787393299.887829:0:14246:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787393299.887873:0:14246:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787393299.887886:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f27a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f27a8 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393299.887897:0:14246:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8040d8e00/0x19a927d9c62f27a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f27a8 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787393299.887907:0:14246:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787393299.887910:0:14246:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de827af4800 from 10 10000000:01000000:2.0:1787393299.887913:0:14246:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787393299.887950:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f27af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393299.887958:0:14246:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f27af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393299.887976:0:14246:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f27af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393299.888002:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338506624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787393299.888063:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393299.891642:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de81817ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787393299.893725:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338506624 00000100:00100000:1.0:1787393299.893738:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338506624 00000100:00100000:1.0:1787393299.893798:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787393299.893808:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+17:14246:x1874217338506624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787393299.893825:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393299.893855:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de8040d9600/0x19a927d9c62f27b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f27af expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393299.893881:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de8040d9600/0x19a927d9c62f27b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f27af expref: 18 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393299.894402:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de8040d9600/0x19a927d9c62f27b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f27af expref: 18 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393299.894425:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d9600, rc 0) 00000100:00100000:1.0:1787393299.894501:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:14246:x1874217338506624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 695us (6436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393299.894509:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787393299.894908:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338506624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787393299.894928:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f27af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f27b6 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393299.894938:0:14246:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f27af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f27b6 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393299.895004:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338506752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787393299.895034:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393299.895066:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de81817ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787393299.895179:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338506752 00000100:00100000:0.0:1787393299.895185:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338506752 00000100:00100000:0.0:1787393299.895220:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787393299.895227:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:14246:x1874217338506752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787393299.897464:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:14246:x1874217338506752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2229us (2421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393299.897477:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787393299.897558:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338506752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787393299.897608:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338506880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787393299.897959:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393299.897990:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de827b33e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787393299.898401:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338506880 00000100:00100000:1.0:1787393299.898408:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338506880 00000100:00100000:1.0:1787393299.898454:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787393299.898463:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e87a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:14246:x1874217338506880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787393299.898653:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e87a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:14246:x1874217338506880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393299.898661:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787393299.899031:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338506880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787393299.900040:0:16318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787393299.900648:0:14246:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787393299.900672:0:14246:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787393299.900683:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f27af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f27b6 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393299.900694:0:14246:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de8186b5200/0x19a927d9c62f27af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f27b6 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787393299.900704:0:14246:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787393299.900707:0:14246:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9de83f587000 from 10 10000000:01000000:3.0:1787393299.900709:0:14246:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787393299.900741:0:14246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de800030a00/0x19a927d9c62f27bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393299.900749:0:14246:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff9de800030a00/0x19a927d9c62f27bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393299.900758:0:14246:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff9de800030a00/0x19a927d9c62f27bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393299.900780:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338507008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787393299.900828:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393299.900885:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de827b33e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787393299.901126:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338507008 00000100:00100000:0.0:1787393299.901141:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338507008 00000100:00100000:0.0:1787393299.901190:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787393299.901199:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+18:14246:x1874217338507008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787393299.901211:0:14243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393299.901223:0:14243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9de82ffbec00/0x19a927d9c62f27c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19a927d9c62f27bd expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393299.901245:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9de82ffbec00/0x19a927d9c62f27c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19a927d9c62f27bd expref: 19 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393299.901255:0:14243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9de82ffbec00/0x19a927d9c62f27c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19a927d9c62f27bd expref: 19 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393299.901262:0:14243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de82ffbec00, rc 0) 00000100:00100000:0.0:1787393299.901492:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:14246:x1874217338507008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 293us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393299.901499:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787393299.902030:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338507008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787393299.902104:0:14246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff9de800030a00/0x19a927d9c62f27bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f27c4 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393299.902113:0:14246:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff9de800030a00/0x19a927d9c62f27bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19a927d9c62f27c4 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393299.902179:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338507136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787393299.902426:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393299.902486:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818104900 going to sleep for 11 seconds 00000100:00100000:0.0:1787393299.902520:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338507136 00000100:00100000:0.0:1787393299.902524:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338507136 00000100:00100000:0.0:1787393299.902585:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787393299.902593:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:14246:x1874217338507136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787393299.902859:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:14246:x1874217338507136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393299.902866:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787393299.902963:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338507136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787393299.902996:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338507264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787393299.903048:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393299.903509:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de827b33240 going to sleep for 11 seconds 00000100:00100000:1.0:1787393299.903558:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338507264 00000100:00100000:1.0:1787393299.903563:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338507264 00000100:00100000:1.0:1787393299.903587:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787393299.903594:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de82e87b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:14246:x1874217338507264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787393299.903869:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de82e87b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:14246:x1874217338507264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 274us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393299.903876:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787393299.904405:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:14246:1874217338507264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787393299.908528:0:16319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787393299.908787:0:14246:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787393299.908810:0:14246:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787393299.908821:0:14246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff9de800030a00/0x19a927d9c62f27bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f27c4 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393299.908832:0:14246:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff9de800030a00/0x19a927d9c62f27bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19a927d9c62f27c4 expref: -99 pid: 14246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393300.135973:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393300.328431:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338507392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787393300.328511:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393300.333534:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787393300.333557:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338507520:0@lo:400:kworker.0 00000100:00100000:2.0:1787393300.333636:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393300.333706:0:14889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338507392 00000100:00100000:2.0:1787393300.333713:0:14889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338507392 00000100:00100000:2.0:1787393300.333770:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787393300.333778:0:14889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338507392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787393300.333829:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393300.333892:0:14889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338507392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (5386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393300.333900:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787393300.333947:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338507392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787393300.335889:0:14887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338507520 00000100:00100000:1.0:1787393300.335902:0:14887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338507520 00000100:00100000:1.0:1787393300.335957:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787393300.335966:0:14887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338507520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787393300.336047:0:14887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338507520:12345-0@lo:400:kworker.0 Request processed in 82us (2422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393300.336054:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787393300.336075:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787393300.336079:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787393300.336346:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338507520:0@lo:400:kworker.0 00000100:00100000:0.0:1787393300.339214:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338507904:0@lo:400:kworker.0 00000100:00100000:0.0:1787393300.339271:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787393300.339302:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338507904 00000100:00100000:0.0:1787393300.339315:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338507904 00000100:00100000:0.0:1787393300.339360:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787393300.339369:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338507904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393300.339415:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1874217338507904:12345-0@lo:400:kworker.0 Request processed in 46us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393300.339422:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787393300.339445:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393300.339473:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1874217338507904:0@lo:400:kworker.0 00000100:00100000:3.0:1787393300.339598:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338507776:0@lo:400:kworker.0 00000100:00100000:3.0:1787393300.339623:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393300.339654:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787393300.339659:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338507648:0@lo:400:kworker.0 00000100:00100000:3.0:1787393300.339677:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393300.339696:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338507776 00000100:00100000:3.0:1787393300.339699:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338507776 00000100:00100000:3.0:1787393300.339720:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338507648 00000100:00100000:3.0:1787393300.339722:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338507648 00000100:00100000:3.0:1787393300.339732:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787393300.339737:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338507776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393300.339764:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338507776:12345-0@lo:400:kworker.0 Request processed in 26us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393300.339770:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787393300.339781:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787393300.339786:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338507648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393300.339804:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338507648:12345-0@lo:400:kworker.0 Request processed in 19us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393300.339820:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787393300.339833:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393300.339875:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338507648:0@lo:400:kworker.0 00000100:00100000:3.0:1787393300.339885:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338507776:0@lo:400:kworker.0 00000100:00100000:1.0:1787393300.842793:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338508032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787393300.842889:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393300.843183:0:14889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338508032 00000100:00100000:2.0:1787393300.843190:0:14889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338508032 00000100:00100000:2.0:1787393300.843239:0:14889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787393300.843248:0:14889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338508032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787393300.843429:0:14889:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393300.843488:0:14889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338508032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 240us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393300.843496:0:14889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787393300.843596:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338508032:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787393301.160100:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393301.857648:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393301.857703:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393301.857720:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319644544 00000100:00100000:1.0:1787393301.857733:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319644544 00000100:00100000:3.0:1787393301.857747:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393301.857793:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 119 00000100:00100000:1.0:1787393301.857806:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8181fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:2356:x1874217319644544:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393301.857884:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393301.857917:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8181fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:2356:x1874217319644544:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 113us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393301.857939:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 119 00000100:00100000:0.0:1787393301.857939:0:14886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319644800 00000100:00100000:0.0:1787393301.857946:0:14886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319644800 00000100:00100000:0.0:1787393301.857989:0:14886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319645312 00000100:00100000:0.0:1787393301.857992:0:14886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319645312 00000100:00100000:0.0:1787393301.858016:0:14886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:0.0:1787393301.858024:0:14886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+5:2356:x1874217319644800:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393301.858089:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319645056 00000100:00100000:2.0:1787393301.858094:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319645056 00000100:00100000:2.0:1787393301.858129:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:2.0:1787393301.858137:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+6:2356:x1874217319645056:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393301.858499:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393301.858522:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393301.858536:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393301.858563:0:14251:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787393301.858571:0:14251:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787393301.858597:0:14250:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787393301.858605:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319644672 00000100:00100000:3.0:1787393301.858608:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319644672 00000100:00100000:3.0:1787393301.858641:0:14250:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787393301.858649:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:3.0:1787393301.858656:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:2356:x1874217319644672:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393301.859553:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:2356:x1874217319644672:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 892us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393301.859563:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00080000:3.0:1787393301.859595:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787393301.859599:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787393301.859602:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787393301.859612:0:16176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319644928 00000100:00100000:3.0:1787393301.859616:0:16176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319644928 00000100:00100000:3.0:1787393301.859756:0:16176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319645184 00000100:00100000:3.0:1787393301.859760:0:16176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319645184 00000100:00100000:3.0:1787393301.859778:0:16176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:3.0:1787393301.859786:0:16176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c97c6862-5e64-402f-825d-1f36dc9c809c+5:2356:x1874217319645312:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393301.859817:0:16176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c97c6862-5e64-402f-825d-1f36dc9c809c+5:2356:x1874217319645312:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 32us (1934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393301.859823:0:16176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:3.0:1787393301.859835:0:16176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:3.0:1787393301.859858:0:16176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+5:2356:x1874217319644928:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393301.859896:0:16176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+5:2356:x1874217319644928:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 39us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393301.859902:0:16176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:3.0:1787393301.859920:0:16176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:3.0:1787393301.859926:0:16176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c97c6862-5e64-402f-825d-1f36dc9c809c+5:2356:x1874217319645184:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393301.859949:0:16176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c97c6862-5e64-402f-825d-1f36dc9c809c+5:2356:x1874217319645184:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 23us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393301.859954:0:16176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00080000:3.0:1787393301.859967:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787393301.859969:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787393301.869019:0:14886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+5:2356:x1874217319644800:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 10984us (11304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393301.869034:0:14886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:3.0:1787393301.878884:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+6:2356:x1874217319645056:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 20736us (21125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393301.878900:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:1.0:1787393302.085916:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393302.086764:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319645440 00000100:00100000:3.0:1787393302.086781:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319645440 00000100:00100000:3.0:1787393302.086903:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:3.0:1787393302.086917:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:14374:x1874217319645440:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787393302.086944:0:14250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393302.086971:0:14250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f27cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0dae8 expref: -99 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.087061:0:14250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f27d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.087079:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f27d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.087119:0:14250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f27d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.087140:0:14250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f27d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.087159:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f27d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.087167:0:14250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f27d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.088721:0:14250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531400/0x19a927d9c62f27e0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.088970:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531400/0x19a927d9c62f27e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.088985:0:14250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531400/0x19a927d9c62f27e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393302.089220:0:14250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787393302.089225:0:14250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787393302.089936:0:14250:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531400/0x19a927d9c62f27e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.089956:0:14250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f27d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.089965:0:14250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f27d2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.089986:0:14250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f27d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.089994:0:14250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393302.089999:0:14250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f27d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.090009:0:14250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f27d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.090536:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de8063da400) 00010000:00010000:3.0:1787393302.090542:0:14250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393302.090548:0:14250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f27d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.090555:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031200/0x19a927d9c62f27d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.090578:0:14250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f27d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.090584:0:14250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f27d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.090590:0:14250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f27d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.090595:0:14250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de800031a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393302.090598:0:14250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f27d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.090616:0:14250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f27d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.090624:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9de8063da800) 00010000:00010000:3.0:1787393302.090627:0:14250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393302.090630:0:14250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f27d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.090636:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031a00/0x19a927d9c62f27d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.090700:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800030c00/0x19a927d9c62f27cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0dae8 expref: 8 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.090719:0:14250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531400/0x19a927d9c62f27e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0dae8 expref: 7 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.090728:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9de8063da700) 00010000:00010000:3.0:1787393302.090730:0:14250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787393302.090733:0:14250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531400, rc 0) 00000100:00100000:3.0:1787393302.092013:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+7:14374:x1874217319645440:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 5085us (6098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393302.092035:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:0.0:1787393302.108223:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393302.109256:0:16377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319645696 00000100:00100000:3.0:1787393302.109287:0:16377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319645696 00000100:00100000:3.0:1787393302.109382:0:16377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:3.0:1787393302.109406:0:16377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+7:14374:x1874217319645696:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787393302.109455:0:16377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393302.109485:0:16377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530a00/0x19a927d9c62f27e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0daef expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.110242:0:16377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f27ee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.110264:0:16377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f27ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.110290:0:16377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f27ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.110598:0:16377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530000/0x19a927d9c62f27f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.110623:0:16377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530000/0x19a927d9c62f27f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.110636:0:16377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530000/0x19a927d9c62f27f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.111681:0:16377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f27fc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.111696:0:16377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f27fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.111705:0:16377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f27fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393302.111717:0:16377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787393302.115266:0:16377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f27ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.115285:0:16377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f27ee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.115294:0:16377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f27ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.115316:0:16377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393302.115321:0:16377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f27ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.115329:0:16377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f27ee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.115348:0:16377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9de8063da700) 00010000:00010000:2.0:1787393302.115351:0:16377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393302.115355:0:16377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f27ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.115362:0:16377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f27ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.115391:0:16377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530000/0x19a927d9c62f27f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.115397:0:16377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530000/0x19a927d9c62f27f5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.115404:0:16377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530000/0x19a927d9c62f27f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.115409:0:16377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393302.115412:0:16377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530000/0x19a927d9c62f27f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.115418:0:16377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530000/0x19a927d9c62f27f5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.115436:0:16377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9de8063da800) 00010000:00010000:2.0:1787393302.115438:0:16377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393302.115441:0:16377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530000/0x19a927d9c62f27f5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.115447:0:16377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530000/0x19a927d9c62f27f5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.115978:0:16377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530a00/0x19a927d9c62f27e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0daef expref: 10 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.115995:0:16377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531e00/0x19a927d9c62f27fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0daef expref: 9 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.116004:0:16377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9de8063dad00) 00010000:00010000:2.0:1787393302.116006:0:16377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393302.116009:0:16377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531e00, rc 0) 00000100:00100000:2.0:1787393302.116073:0:16377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+9:14374:x1874217319645696:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 6680us (7867us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787393302.116082:0:16377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:0.0:1787393302.128099:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393302.128338:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319645824 00000100:00100000:3.0:1787393302.128353:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319645824 00000100:00100000:3.0:1787393302.128441:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:3.0:1787393302.128454:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+9:14374:x1874217319645824:12345-192.168.203.21@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787393302.128607:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+9:14374:x1874217319645824:12345-192.168.203.21@tcp:59:lhsmtool_posix.0 Request processed in 156us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393302.128616:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:1.0:1787393302.171201:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393302.171394:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319645952 00000100:00100000:0.0:1787393302.171408:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319645952 00000100:00100000:0.0:1787393302.171484:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:0.0:1787393302.171496:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+9:14380:x1874217319645952:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1787393302.171523:0:14249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393302.171549:0:14249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe000/0x19a927d9c62f280a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0daf6 expref: -99 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.171670:0:14249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2811 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.171687:0:14249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.171701:0:14249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.171719:0:14249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2818 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.171726:0:14249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.171733:0:14249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.172140:0:14249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.172161:0:14249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2811 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.172168:0:14249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2811 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.172175:0:14249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbe400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393302.172180:0:14249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2811 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.172198:0:14249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2811 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.172215:0:14249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de8063da400) 00010000:00010000:0.0:1787393302.172218:0:14249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393302.172224:0:14249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2811 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.172230:0:14249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2811 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.172246:0:14249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.172252:0:14249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2818 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.172258:0:14249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2818 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.172264:0:14249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbfe00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393302.172267:0:14249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2818 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.172273:0:14249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2818 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.172280:0:14249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9de807df8d00) 00010000:00010000:0.0:1787393302.172282:0:14249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393302.172285:0:14249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2818 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.172301:0:14249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2818 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.172339:0:14249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe000/0x19a927d9c62f280a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0daf6 expref: 10 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.172351:0:14249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de8063da400) 00010000:00010000:0.0:1787393302.172353:0:14249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393302.172357:0:14249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe000/0x19a927d9c62f280a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0daf6 expref: 10 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.172367:0:14249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de82ffbe000, rc 0) 00000100:00100000:0.0:1787393302.172448:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+9:14380:x1874217319645952:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 954us (1262us total) trans 0 rc 301/301 00000100:00100000:0.0:1787393302.172459:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:1.0:1787393302.177488:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393302.181918:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319646080 00000100:00100000:0.0:1787393302.181942:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319646080 00000100:00100000:0.0:1787393302.182033:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:0.0:1787393302.182048:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+9:14380:x1874217319646080:12345-192.168.203.21@tcp:700:lfs.0 00000100:00100000:0.0:1787393302.182212:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+9:14380:x1874217319646080:12345-192.168.203.21@tcp:700:lfs.0 Request processed in 165us (4735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393302.182222:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00010000:00010000:2.0:1787393302.184298:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393302.195504:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393302.195644:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319646336 00000100:00100000:3.0:1787393302.195658:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319646336 00000100:00100000:3.0:1787393302.195745:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:3.0:1787393302.195757:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+9:14380:x1874217319646336:12345-192.168.203.21@tcp:36:lfs.0 00010000:00010000:3.0:1787393302.195874:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393302.195910:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de800031c00/0x19a927d9c62f274d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0da71 expref: 9 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.195938:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de8063da400) 00010000:00010000:3.0:1787393302.195949:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787393302.196586:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f281f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.196610:0:14251:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2785 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0dad3 expref: 5 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.196620:0:14251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f281f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.196664:0:14251:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2785 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0dad3 expref: 5 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.196696:0:14251:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2785 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0dad3 expref: 5 pid: 14251 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393302.196716:0:14251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14251:1874217338508160:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393302.196931:0:14251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de827b336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787393302.200213:0:14251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14251:1874217338508160:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393302.200263:0:14251:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f281f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393302.200686:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393302.200939:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319646464 00000100:00100000:1.0:1787393302.200949:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319646464 00010000:00010000:1.0:1787393302.201000:0:14236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2785 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0dad3 expref: 6 pid: 14251 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393302.201042:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:1.0:1787393302.201063:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835254380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c97c6862-5e64-402f-825d-1f36dc9c809c+6:2356:x1874217319646464:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393302.201081:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393302.201088:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2785 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0dad3 expref: 6 pid: 14251 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.201102:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2785 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0dad3 expref: 6 pid: 14251 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.201135:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2785 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0dad3 expref: 6 pid: 14251 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.201165:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de8063da400) 00010000:00010000:1.0:1787393302.201172:0:14236:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f281f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.201203:0:14236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f281f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.201211:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f281f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.201246:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393302.201323:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835254380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c97c6862-5e64-402f-825d-1f36dc9c809c+5:2356:x1874217319646464:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 270us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393302.201333:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00010000:00010000:0.0:1787393302.201908:0:14251:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f281f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.201920:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f281f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.201959:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe000/0x19a927d9c62f2826 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.201970:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe000/0x19a927d9c62f2826 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.201979:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe000/0x19a927d9c62f2826 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393302.211248:0:14251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787393302.211284:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f281f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.211297:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f281f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.211306:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f281f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.211312:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393302.211318:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f281f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.211326:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f281f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.211522:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de8063da400) 00010000:00010000:0.0:1787393302.211526:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393302.211532:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f281f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.211562:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f281f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787393302.211595:0:14251:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a64295f4 reply state 00000000b5d5ea6e transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe000/0x19a927d9c62f2826 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393302.211606:0:14251:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787393302.211892:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+10:14380:x1874217319646336:12345-192.168.203.21@tcp:36:lfs.0 Request processed in 16131us (16544us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787393302.211903:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 19 00010000:00010000:1.0:1787393302.215000:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe000/0x19a927d9c62f2826 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.215022:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe000/0x19a927d9c62f2826 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.215030:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe000/0x19a927d9c62f2826 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.215037:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbe000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393302.215043:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe000/0x19a927d9c62f2826 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.215059:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe000/0x19a927d9c62f2826 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.215079:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9de807df8d00) 00010000:00010000:1.0:1787393302.215082:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393302.215087:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe000/0x19a927d9c62f2826 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.215115:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe000/0x19a927d9c62f2826 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393302.352013:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393302.352177:0:16377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319646592 00000100:00100000:2.0:1787393302.352190:0:16377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319646592 00000100:00100000:2.0:1787393302.352268:0:16377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:2.0:1787393302.352288:0:16377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+9:14388:x1874217319646592:12345-192.168.203.21@tcp:101:lctl.0 00010000:00010000:2.0:1787393302.352322:0:16377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393302.352380:0:16377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f282d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0dafd expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.352691:0:16377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f2834 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.352707:0:16377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f2834 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.352719:0:16377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f2834 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787393302.353225:0:16377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787393302.353232:0:16377:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787393302.353539:0:16377:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f2834 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.353584:0:16377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f282d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0dafd expref: 11 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.353611:0:16377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4c00/0x19a927d9c62f2834 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0dafd expref: 10 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393302.353622:0:16377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:2.0:1787393302.353625:0:16377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787393302.353629:0:16377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4c00, rc 0) 00000100:00100000:2.0:1787393302.353741:0:16377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+10:14388:x1874217319646592:12345-192.168.203.21@tcp:101:lctl.0 Request processed in 1454us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393302.353752:0:16377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:0.0:1787393302.390743:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393302.390984:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319646720 00000100:00100000:3.0:1787393302.390998:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319646720 00000100:00100000:3.0:1787393302.391075:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:3.0:1787393302.391086:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c97c6862-5e64-402f-825d-1f36dc9c809c+5:14389:x1874217319646720:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1787393302.391115:0:14250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393302.391140:0:14250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f283b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db04 expref: -99 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.391234:0:14250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f2842 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.391251:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f2842 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.391264:0:14250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f2842 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393302.391556:0:14250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787393302.391574:0:14250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787393302.391605:0:14250:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f2842 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.391636:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f283b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db04 expref: 7 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.391658:0:14250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531800/0x19a927d9c62f2842 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db04 expref: 6 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.391667:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:3.0:1787393302.391670:0:14250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787393302.391675:0:14250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531800, rc 0) 00000100:00100000:3.0:1787393302.392034:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c97c6862-5e64-402f-825d-1f36dc9c809c+6:14389:x1874217319646720:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 946us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393302.392044:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:1.0:1787393302.406632:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393302.407355:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319646848 00000100:00100000:0.0:1787393302.407371:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319646848 00000100:00100000:0.0:1787393302.407451:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:0.0:1787393302.407464:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+6:14389:x1874217319646848:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1787393302.407490:0:14249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393302.407517:0:14249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2849 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db0b expref: -99 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.407607:0:14249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2850 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.407625:0:14249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2850 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.407639:0:14249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2850 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.407657:0:14249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2857 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.407685:0:14249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2857 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.407693:0:14249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2857 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.410353:0:14249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf600/0x19a927d9c62f285e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.410376:0:14249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf600/0x19a927d9c62f285e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.410388:0:14249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf600/0x19a927d9c62f285e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393302.410453:0:14249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787393302.410457:0:14249:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787393302.410483:0:14249:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf600/0x19a927d9c62f285e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.410496:0:14249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2850 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.410503:0:14249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2850 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.410510:0:14249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2850 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.410516:0:14249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbe400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393302.410520:0:14249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2850 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.410956:0:14249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2850 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.410970:0:14249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:0.0:1787393302.410973:0:14249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393302.410977:0:14249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2850 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.410982:0:14249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2850 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.410998:0:14249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2857 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.411004:0:14249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2857 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.411009:0:14249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2857 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.411014:0:14249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbe200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393302.411017:0:14249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2857 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.411023:0:14249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2857 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.411030:0:14249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9de807df8200) 00010000:00010000:0.0:1787393302.411032:0:14249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393302.411035:0:14249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2857 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.411051:0:14249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2857 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.411338:0:14249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2849 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db0b expref: 8 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.411355:0:14249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf600/0x19a927d9c62f285e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db0b expref: 7 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.411362:0:14249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:0.0:1787393302.411364:0:14249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787393302.411366:0:14249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de82ffbf600, rc 0) 00000100:00100000:0.0:1787393302.411515:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+7:14389:x1874217319646848:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 4052us (4897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393302.411524:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:1.0:1787393302.429751:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393302.429879:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319647104 00000100:00100000:0.0:1787393302.429894:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319647104 00000100:00100000:0.0:1787393302.429973:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:0.0:1787393302.429985:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c97c6862-5e64-402f-825d-1f36dc9c809c+7:14389:x1874217319647104:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1787393302.430013:0:14251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393302.430051:0:14251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2865 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db12 expref: -99 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393302.430227:0:14251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787393302.430405:0:14251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2865 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db12 expref: 9 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.430446:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:0.0:1787393302.430450:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787393302.430456:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2865 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db12 expref: 9 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.430475:0:14251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de82ffbfe00, rc 0) 00000100:00100000:0.0:1787393302.430559:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c97c6862-5e64-402f-825d-1f36dc9c809c+8:14389:x1874217319647104:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 577us (822us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787393302.430568:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:2.0:1787393302.441770:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393302.441996:0:16377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319647360 00000100:00100000:3.0:1787393302.442008:0:16377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319647360 00000100:00100000:3.0:1787393302.442079:0:16377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 24 00000100:00100000:3.0:1787393302.442091:0:16377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c97c6862-5e64-402f-825d-1f36dc9c809c+8:14389:x1874217319647360:12345-192.168.203.21@tcp:36:lfs.0 00010000:00010000:3.0:1787393302.442162:0:16377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393302.442191:0:16377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf600/0x19a927d9c62f285e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db0b expref: 8 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.442212:0:16377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:3.0:1787393302.442223:0:16377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787393302.442247:0:16377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f2873 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.442272:0:16377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f2873 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.442282:0:16377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f2873 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787393302.442507:0:16377:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d7b50b16 reply state 0000000080c1a52c transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f2873 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393302.442517:0:16377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787393302.442530:0:16377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787393302.442619:0:16377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c97c6862-5e64-402f-825d-1f36dc9c809c+9:14389:x1874217319647360:12345-192.168.203.21@tcp:36:lfs.0 Request processed in 531us (857us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787393302.442626:0:16377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 24 00010000:00010000:0.0:1787393302.448742:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f2873 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.448760:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f2873 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.448767:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f2873 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.448774:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393302.448779:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f2873 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.448787:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f2873 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.448814:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9de8063da300) 00010000:00010000:0.0:1787393302.448818:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787393302.448822:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f2873 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.448867:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f2873 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393302.452070:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393302.452250:0:14252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319647616 00000100:00100000:3.0:1787393302.452260:0:14252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319647616 00000100:00100000:3.0:1787393302.452391:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:3.0:1787393302.452402:0:14252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+8:14389:x1874217319647616:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:3.0:1787393302.452924:0:14252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+9:14389:x1874217319647616:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 522us (861us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787393302.452933:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:1.0:1787393302.474098:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393302.476398:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319647872 00000100:00100000:0.0:1787393302.476412:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319647872 00000100:00100000:0.0:1787393302.476485:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:0.0:1787393302.476495:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c97c6862-5e64-402f-825d-1f36dc9c809c+9:14389:x1874217319647872:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1787393302.476519:0:14251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393302.476549:0:14251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f287a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db19 expref: -99 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.476622:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2881 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.476636:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2881 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.476646:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2881 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.476660:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2888 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.476667:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.476674:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393302.477576:0:14251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787393302.477698:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2881 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.477708:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2881 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.477715:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2881 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.477720:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbe200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393302.477725:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2881 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.477732:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2881 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.477746:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:0.0:1787393302.477749:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393302.477754:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2881 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.477760:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe200/0x19a927d9c62f2881 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.477775:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.477781:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2888 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.477786:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2888 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.477815:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbe400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393302.477818:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2888 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.477824:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2888 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.477832:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9de807df8200) 00010000:00010000:0.0:1787393302.477834:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393302.477851:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2888 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.477858:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f2888 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.477904:0:14251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f287a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db19 expref: 11 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.477914:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:0.0:1787393302.477916:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787393302.477920:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f287a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db19 expref: 11 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.477929:0:14251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de82ffbfe00, rc 0) 00000100:00100000:0.0:1787393302.477992:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c97c6862-5e64-402f-825d-1f36dc9c809c+10:14389:x1874217319647872:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1498us (3901us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787393302.478000:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:1.0:1787393302.487307:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393302.487503:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319648000 00000100:00100000:0.0:1787393302.487525:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319648000 00000100:00100000:0.0:1787393302.487615:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 26 00000100:00100000:0.0:1787393302.487625:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+10:14389:x1874217319648000:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1787393302.487647:0:14249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393302.487668:0:14249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2896 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db20 expref: -99 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.487755:0:14249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f289d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.487768:0:14249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f289d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.487785:0:14249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f289d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393302.487832:0:14249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787393302.487835:0:14249:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787393302.487887:0:14249:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f289d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.487911:0:14249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2896 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db20 expref: 12 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.487928:0:14249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f289d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db20 expref: 11 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.487937:0:14249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9de807df8200) 00010000:00010000:0.0:1787393302.487940:0:14249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787393302.487943:0:14249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de82ffbe400, rc 0) 00000100:00100000:0.0:1787393302.487994:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+11:14389:x1874217319648000:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 371us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393302.488001:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 26 00000100:00100000:2.0:1787393302.496470:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393302.496582:0:14253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319648128 00000100:00100000:3.0:1787393302.496593:0:14253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319648128 00000100:00100000:3.0:1787393302.496648:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:3.0:1787393302.496659:0:14253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c97c6862-5e64-402f-825d-1f36dc9c809c+11:14389:x1874217319648128:12345-192.168.203.21@tcp:37:lfs.0 00000100:00100000:2.0:1787393302.515772:0:14253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c97c6862-5e64-402f-825d-1f36dc9c809c+11:14389:x1874217319648128:12345-192.168.203.21@tcp:37:lfs.0 Request processed in 19098us (19295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393302.515790:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:1.0:1787393302.526695:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393302.527248:0:14252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319648384 00000100:00100000:2.0:1787393302.527271:0:14252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319648384 00000100:00100000:2.0:1787393302.527363:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:2.0:1787393302.527375:0:14252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c005050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+11:14389:x1874217319648384:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1787393302.527738:0:14252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c005050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+12:14389:x1874217319648384:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 364us (1056us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787393302.527748:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:0.0:1787393302.601912:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393302.602031:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319648512 00000100:00100000:3.0:1787393302.602045:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319648512 00000100:00100000:3.0:1787393302.602159:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:3.0:1787393302.602171:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+10:14395:x1874217319648512:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1787393302.602199:0:14251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393302.602225:0:14251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f28a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db27 expref: -99 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602311:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602333:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602347:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602364:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602372:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602377:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602516:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f28b9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602525:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f28b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602533:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f28b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393302.602586:0:14251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787393302.602590:0:14251:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787393302.602634:0:14251:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f28b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602648:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602654:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602660:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602666:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393302.602671:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602679:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602692:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:3.0:1787393302.602695:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393302.602701:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602707:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602725:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602742:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602749:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602754:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393302.602757:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602764:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602773:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9de8063dac00) 00010000:00010000:3.0:1787393302.602775:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393302.602778:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602784:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602823:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f28a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db27 expref: 12 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602897:0:14251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531600/0x19a927d9c62f28b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db27 expref: 11 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.602905:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9de807df8200) 00010000:00010000:3.0:1787393302.602907:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787393302.602916:0:14251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531600, rc 0) 00000100:00100000:3.0:1787393302.603005:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+11:14395:x1874217319648512:12345-192.168.203.21@tcp:101:bash.0 Request processed in 835us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393302.603013:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:1.0:1787393302.608717:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393302.608876:0:16377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319648768 00000100:00100000:3.0:1787393302.608890:0:16377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319648768 00000100:00100000:3.0:1787393302.608952:0:16377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:3.0:1787393302.608963:0:16377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+11:14395:x1874217319648768:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1787393302.608992:0:16377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393302.609018:0:16377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f28c0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db2e expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.609202:0:16377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28c7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.609219:0:16377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f289d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db20 expref: 11 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.609230:0:16377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28c7 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.609273:0:16377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f289d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db20 expref: 11 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.609289:0:16377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f289d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db20 expref: 11 pid: 14249 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393302.609306:0:16377:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f75c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16377:1874217338508288:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393302.609457:0:16377:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de827b33cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787393302.620415:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393302.620760:0:16377:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f75c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16377:1874217338508288:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393302.620796:0:16377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28c7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393302.620939:0:14234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319648896 00000100:00100000:1.0:1787393302.620949:0:14234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319648896 00010000:00010000:1.0:1787393302.620997:0:14234:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f289d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db20 expref: 12 pid: 14249 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393302.621044:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:1.0:1787393302.621055:0:14234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+12:2356:x1874217319648896:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393302.621073:0:14234:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393302.621080:0:14234:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f289d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db20 expref: 12 pid: 14249 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.621094:0:14234:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f289d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db20 expref: 12 pid: 14249 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.621131:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f289d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db20 expref: 12 pid: 14249 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.621184:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9de807df8200) 00010000:00010000:1.0:1787393302.621190:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28c7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.621200:0:14234:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28c7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.621210:0:14234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28c7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.621243:0:14234:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393302.621328:0:14234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+11:2356:x1874217319648896:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 273us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393302.621337:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00010000:00010000:3.0:1787393302.621929:0:16377:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28c7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.621942:0:16377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28c7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.621973:0:16377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ce lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.621986:0:16377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.621997:0:16377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.625542:0:16377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe600/0x19a927d9c62f28d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.625572:0:16377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe600/0x19a927d9c62f28d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.625587:0:16377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe600/0x19a927d9c62f28d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393302.625602:0:16377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787393302.625640:0:16377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28c7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.625648:0:16377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28c7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.625655:0:16377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28c7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.625662:0:16377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393302.625667:0:16377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28c7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.625675:0:16377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28c7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.625690:0:16377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9de807df8200) 00010000:00010000:0.0:1787393302.625694:0:16377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393302.625883:0:16377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28c7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.625890:0:16377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f28c7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787393302.625912:0:16377:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000010b0a66f reply state 000000003b995c5e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393302.625923:0:16377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787393302.625973:0:16377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f28c0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db2e expref: 14 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.625990:0:16377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe600/0x19a927d9c62f28d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db2e expref: 13 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.625998:0:16377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:0.0:1787393302.626000:0:16377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787393302.626003:0:16377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de82ffbe600, rc 0) 00000100:00100000:0.0:1787393302.626105:0:16377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+14:14395:x1874217319648768:12345-192.168.203.21@tcp:101:bash.0 Request processed in 17143us (17411us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787393302.626116:0:16377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 28 00010000:00010000:1.0:1787393302.631889:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.631912:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ce lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.631920:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.631927:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393302.631933:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.631941:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ce lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.631985:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9de8063dac00) 00010000:00010000:1.0:1787393302.631988:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787393302.631994:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ce lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.632001:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28ce lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393302.657017:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393302.663541:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319649024 00000100:00100000:3.0:1787393302.663563:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319649024 00000100:00100000:3.0:1787393302.663654:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:3.0:1787393302.663668:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+13:14395:x1874217319649024:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1787393302.663821:0:14251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393302.663869:0:14251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db35 expref: -99 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.663962:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f28ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.664003:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f28ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.664018:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f28ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393302.664075:0:14251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787393302.664080:0:14251:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787393302.664102:0:14251:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f28ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.664114:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f28ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.664156:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f28e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db35 expref: 15 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.664179:0:14251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f28ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db35 expref: 14 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393302.664190:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:3.0:1787393302.664194:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787393302.664199:0:14251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530200, rc 0) 00000100:00100000:3.0:1787393302.664367:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+14:14395:x1874217319649024:12345-192.168.203.21@tcp:101:bash.0 Request processed in 701us (7364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393302.664376:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:2.0:1787393302.668515:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393302.669044:0:14252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319649280 00000100:00100000:3.0:1787393302.669059:0:14252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319649280 00000100:00100000:2.0:1787393302.672046:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:2.0:1787393302.672066:0:14252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+14:14395:x1874217319649280:12345-192.168.203.21@tcp:35:bash.0 00000001:00080000:2.0:1787393302.672493:0:14252:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:2.0:1787393302.672665:0:14252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+16:14395:x1874217319649280:12345-192.168.203.21@tcp:35:bash.0 Request processed in 603us (4164us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1787393302.672675:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00000020:00080000:2.0:1787393302.672682:0:14252:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1787393302.760716:0:14283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787393302.785471:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393302.785576:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319649536 00000100:00100000:0.0:1787393302.785592:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319649536 00000100:00100000:0.0:1787393302.785682:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:0.0:1787393302.785695:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+16:14405:x1874217319649536:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1787393302.785738:0:14249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393302.785791:0:14249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbee00/0x19a927d9c62f28f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db3c expref: -99 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393302.786021:0:14249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787393302.786197:0:14249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbee00/0x19a927d9c62f28f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db3c expref: 18 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.786217:0:14249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9de818bd8700) 00010000:00010000:0.0:1787393302.786220:0:14249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787393302.786226:0:14249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbee00/0x19a927d9c62f28f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db3c expref: 18 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.786242:0:14249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de82ffbee00, rc 0) 00000100:00100000:0.0:1787393302.786336:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+17:14405:x1874217319649536:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 643us (878us total) trans 8589934603 rc 301/301 00000100:00100000:0.0:1787393302.786345:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:1.0:1787393302.792417:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393302.792557:0:14253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319649792 00000100:00100000:0.0:1787393302.792571:0:14253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319649792 00000100:00100000:0.0:1787393302.792638:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:0.0:1787393302.792649:0:14253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+17:14405:x1874217319649792:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:0.0:1787393302.793046:0:14253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+18:14405:x1874217319649792:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 396us (641us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787393302.793056:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:0.0:1787393302.837824:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393302.838162:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319650048 00000100:00100000:1.0:1787393302.838175:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319650048 00000100:00100000:1.0:1787393302.838249:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 31 00000100:00100000:1.0:1787393302.838260:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+18:14408:x1874217319650048:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787393302.838301:0:14250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393302.838326:0:14250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f28ff lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db43 expref: -99 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.838453:0:14250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f2906 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.838469:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f2906 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.838483:0:14250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f2906 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393302.838495:0:14250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787393302.838657:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8800/0x19a927d9c62f28ff lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db43 expref: 21 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.838768:0:14250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f2906 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db43 expref: 20 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.838778:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:1.0:1787393302.838781:0:14250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787393302.838784:0:14250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d8c00, rc 0) 00000100:00100000:1.0:1787393302.838994:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+20:14408:x1874217319650048:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 733us (1183us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787393302.839003:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 31 00000100:00100000:3.0:1787393302.843773:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393302.843950:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393302.844001:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319650304 00000100:00100000:1.0:1787393302.844013:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319650304 00000100:00100000:1.0:1787393302.844088:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:1.0:1787393302.844100:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+20:2354:x1874217319650304:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393302.844121:0:14235:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393302.844171:0:14235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8c00/0x19a927d9c62f2906 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db43 expref: 20 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393302.844195:0:14235:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:1.0:1787393302.844200:0:14235:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393302.844292:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+19:2354:x1874217319650304:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 194us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393302.844300:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:0.0:1787393302.844673:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319650176 00000100:00100000:0.0:1787393302.844680:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319650176 00000100:00100000:0.0:1787393302.844763:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00100000:0.0:1787393302.844772:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f75c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+19:14408:x1874217319650176:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:0.0:1787393302.844903:0:14249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf400/0x19a927d9c62f2914 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.844920:0:14249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf400/0x19a927d9c62f2914 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.844932:0:14249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf400/0x19a927d9c62f2914 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.844968:0:14249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf400/0x19a927d9c62f2914 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.844977:0:14249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf400/0x19a927d9c62f2914 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.844983:0:14249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf400/0x19a927d9c62f2914 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.845004:0:14249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbf400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393302.845009:0:14249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf400/0x19a927d9c62f2914 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.845017:0:14249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf400/0x19a927d9c62f2914 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.845027:0:14249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:0.0:1787393302.845030:0:14249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787393302.845033:0:14249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf400/0x19a927d9c62f2914 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393302.845038:0:14249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf400/0x19a927d9c62f2914 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393302.845106:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f75c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+19:14408:x1874217319650176:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 335us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393302.845113:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00100000:3.0:1787393302.847707:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393302.847806:0:14253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319650560 00000100:00100000:0.0:1787393302.847819:0:14253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319650560 00000100:00100000:0.0:1787393302.848160:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:0.0:1787393302.848175:0:14253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+19:14408:x1874217319650560:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:0.0:1787393302.848513:0:14253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+20:14408:x1874217319650560:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 341us (817us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787393302.848522:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:1.0:1787393303.138658:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393303.138802:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319650816 00000100:00100000:3.0:1787393303.138813:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319650816 00000100:00100000:3.0:1787393303.138912:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:3.0:1787393303.138924:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+20:14439:x1874217319650816:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:3.0:1787393303.138945:0:14250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393303.138965:0:14250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f291b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db4a expref: -99 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.139061:0:14250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f2922 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.139076:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f2922 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.139087:0:14250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f2922 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787393303.139099:0:14250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787393303.139255:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f291b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db4a expref: 23 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.139286:0:14250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f2922 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db4a expref: 22 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.139295:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:3.0:1787393303.139298:0:14250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787393303.139301:0:14250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530400, rc 0) 00000100:00100000:3.0:1787393303.139377:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+22:14439:x1874217319650816:12345-192.168.203.21@tcp:101:cat.0 Request processed in 456us (733us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787393303.139385:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00080000:0.0:1787393303.139822:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787393303.143425:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393303.143522:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393303.143669:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319651200 00000100:00100000:1.0:1787393303.143680:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319651200 00000100:00100000:1.0:1787393303.143760:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:1.0:1787393303.143775:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+22:2353:x1874217319651200:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393303.143791:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393303.143818:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530400/0x19a927d9c62f2922 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db4a expref: 22 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.143872:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:1.0:1787393303.143879:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393303.143930:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+21:2353:x1874217319651200:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 161us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393303.143938:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:2.0:1787393303.146604:0:14252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319651072 00000100:00100000:2.0:1787393303.146627:0:14252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319651072 00000100:00100000:2.0:1787393303.146701:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:2.0:1787393303.146712:0:14252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+21:14439:x1874217319651072:12345-192.168.203.21@tcp:35:cat.0 00000100:00100000:2.0:1787393303.147351:0:14252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+22:14439:x1874217319651072:12345-192.168.203.21@tcp:35:cat.0 Request processed in 638us (3931us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787393303.147362:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00010000:00010000:2.0:1787393303.210869:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787393303.213877:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393303.215337:0:16377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319651456 00000100:00100000:2.0:1787393303.215351:0:16377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319651456 00000100:00100000:2.0:1787393303.215420:0:16377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:2.0:1787393303.215431:0:16377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+22:14445:x1874217319651456:12345-192.168.203.21@tcp:101:dd.0 00010000:00010000:2.0:1787393303.215465:0:16377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787393303.215487:0:16377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f2930 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db51 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.215585:0:16377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f2937 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.215599:0:16377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe600/0x19a927d9c62f28d5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db2e expref: 23 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.215609:0:16377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f28ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db35 expref: 23 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.215618:0:16377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f2937 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.215666:0:16377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f28ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db35 expref: 23 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.215681:0:16377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f28ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db35 expref: 23 pid: 14251 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393303.215967:0:16377:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16377:1874217338508416:192.168.203.21@tcp:104: 00010000:00010000:2.0:1787393303.216084:0:16377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe600/0x19a927d9c62f28d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db2e expref: 23 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.216093:0:16377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe600/0x19a927d9c62f28d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db2e expref: 23 pid: 16377 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393303.216102:0:16377:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f5f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16377:1874217338508544:192.168.203.21@tcp:104: 00000100:00100000:2.0:1787393303.216125:0:16377:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de81817ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787393303.219532:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393303.219595:0:16377:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16377:1874217338508416:192.168.203.21@tcp:104: 00000100:00100000:2.0:1787393303.219611:0:16377:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f5f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16377:1874217338508544:192.168.203.21@tcp:104: 00010000:00010000:2.0:1787393303.219636:0:16377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f2937 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393303.219658:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319651584 00000100:00100000:1.0:1787393303.219667:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319651584 00010000:00010000:1.0:1787393303.219704:0:14235:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe600/0x19a927d9c62f28d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db2e expref: 24 pid: 16377 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393303.219749:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:1.0:1787393303.219759:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de81871a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+24:2355:x1874217319651584:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393303.219774:0:14235:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393303.219781:0:14235:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe600/0x19a927d9c62f28d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db2e expref: 24 pid: 16377 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.219793:0:14235:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe600/0x19a927d9c62f28d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db2e expref: 24 pid: 16377 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.219814:0:14235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe600/0x19a927d9c62f28d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db2e expref: 24 pid: 16377 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.219898:0:14235:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:1.0:1787393303.219903:0:14235:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f2937 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.219911:0:14235:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f2937 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.219918:0:14235:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393303.219986:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de81871a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+23:2355:x1874217319651584:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 228us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393303.219995:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:0.0:1787393303.221007:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393303.221911:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319651712 00000100:00100000:1.0:1787393303.221922:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319651712 00010000:00010000:1.0:1787393303.221970:0:14236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f28ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db35 expref: 23 pid: 14251 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393303.222012:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:1.0:1787393303.222033:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+23:2356:x1874217319651712:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393303.222054:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393303.222060:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f28ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db35 expref: 23 pid: 14251 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.222073:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f28ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db35 expref: 23 pid: 14251 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.222094:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530200/0x19a927d9c62f28ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db35 expref: 23 pid: 14251 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.222123:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:1.0:1787393303.222128:0:14236:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f2937 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.222147:0:14236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f2937 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.222154:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f2937 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.222188:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787393303.222503:0:16377:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f2937 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.222512:0:16377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f2937 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393303.222535:0:16377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00100000:1.0:1787393303.222579:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+22:2356:x1874217319651712:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 557us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393303.222587:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00010000:00010000:0.0:1787393303.225508:0:16377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5000/0x19a927d9c62f2930 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db51 expref: 23 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.225537:0:16377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b4800/0x19a927d9c62f2937 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db51 expref: 22 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.225545:0:16377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:0.0:1787393303.225548:0:16377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787393303.225563:0:16377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8186b4800, rc 0) 00000100:00100000:0.0:1787393303.225672:0:16377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+22:14445:x1874217319651456:12345-192.168.203.21@tcp:101:dd.0 Request processed in 10242us (11838us total) trans 8589934609 rc 0/0 00000100:00100000:0.0:1787393303.225681:0:16377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:2.0:1787393303.233118:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393303.233173:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319651968 00000100:00100000:1.0:1787393303.233182:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319651968 00000100:00100000:1.0:1787393303.233244:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00100000:1.0:1787393303.233253:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+22:14445:x1874217319651968:12345-192.168.203.21@tcp:36:dd.0 00010000:00010000:1.0:1787393303.233517:0:14250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8a00/0x19a927d9c62f2945 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.233534:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8a00/0x19a927d9c62f2945 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.233544:0:14250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8a00/0x19a927d9c62f2945 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787393303.233594:0:14250:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:1.0:1787393303.233617:0:14250:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007fd5d3ea reply state 0000000044df6409 transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8a00/0x19a927d9c62f2945 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393303.233638:0:14250:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787393303.233730:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+25:14445:x1874217319651968:12345-192.168.203.21@tcp:36:dd.0 Request processed in 477us (620us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1787393303.233737:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 35 00000020:00080000:1.0:1787393303.233742:0:14250:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787393303.237359:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8a00/0x19a927d9c62f2945 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.237377:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8a00/0x19a927d9c62f2945 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.237384:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8a00/0x19a927d9c62f2945 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.237391:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393303.237395:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8a00/0x19a927d9c62f2945 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.237403:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8a00/0x19a927d9c62f2945 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.237418:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:0.0:1787393303.237420:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393303.237431:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8a00/0x19a927d9c62f2945 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.237437:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8a00/0x19a927d9c62f2945 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393303.239882:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393303.239976:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319652096 00000100:00100000:0.0:1787393303.239987:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319652096 00000100:00100000:0.0:1787393303.240046:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:0.0:1787393303.240055:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+24:14445:x1874217319652096:12345-192.168.203.21@tcp:101:dd.0 00010000:00010000:0.0:1787393303.240097:0:14249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787393303.240116:0:14249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f294c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db58 expref: -99 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.240181:0:14249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f294c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db58 expref: 25 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.240196:0:14249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f294c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db58 expref: 25 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.240213:0:14249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:0.0:1787393303.240220:0:14249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787393303.240223:0:14249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de82ffbe400, rc 0) 00000100:00100000:0.0:1787393303.240281:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+25:14445:x1874217319652096:12345-192.168.203.21@tcp:101:dd.0 Request processed in 227us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393303.240288:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:1.0:1787393303.269051:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393303.270394:0:14234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319652352 00000100:00100000:3.0:1787393303.270408:0:14234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319652352 00000100:00100000:3.0:1787393303.270482:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:3.0:1787393303.270494:0:14234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+25:14445:x1874217319652352:12345-192.168.203.21@tcp:103:dd.0 00010000:00010000:3.0:1787393303.270510:0:14234:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393303.270534:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe400/0x19a927d9c62f294c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db58 expref: 25 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.270554:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:3.0:1787393303.270558:0:14234:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393303.270624:0:14234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+24:14445:x1874217319652352:12345-192.168.203.21@tcp:103:dd.0 Request processed in 133us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393303.270631:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:2.0:1787393303.278282:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393303.278381:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319652480 00000100:00100000:1.0:1787393303.278392:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319652480 00000100:00100000:1.0:1787393303.278453:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:1.0:1787393303.278463:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+24:14445:x1874217319652480:12345-192.168.203.21@tcp:58:dd.0 00010000:00010000:1.0:1787393303.278568:0:14250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9a00/0x19a927d9c62f2953 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.278584:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9a00/0x19a927d9c62f2953 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.278595:0:14250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9a00/0x19a927d9c62f2953 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787393303.279383:0:14250:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787393303.279534:0:14250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787393303.279602:0:14250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787393303.279701:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+24:14445:x1874217319652480:12345-192.168.203.21@tcp:58:dd.0 Request processed in 1235us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393303.279710:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:0.0:1787393303.281625:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393303.281708:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319652608 00000100:00100000:3.0:1787393303.281717:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319652608 00000100:00100000:3.0:1787393303.281773:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00100000:3.0:1787393303.281783:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+24:14445:x1874217319652608:12345-192.168.203.21@tcp:101:dd.0 00010000:00010000:3.0:1787393303.281812:0:14249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393303.281831:0:14249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f295a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db5f expref: -99 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.281942:0:14249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9a00/0x19a927d9c62f2953 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.281952:0:14249:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f295a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db5f expref: 25 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.281969:0:14249:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9a00/0x19a927d9c62f2953 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.281982:0:14249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f295a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db5f expref: 25 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.281995:0:14249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:3.0:1787393303.281998:0:14249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787393303.282002:0:14249:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f295a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db5f expref: 25 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.282009:0:14249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801531a00, rc 0) 00000100:00100000:3.0:1787393303.282057:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+25:14445:x1874217319652608:12345-192.168.203.21@tcp:101:dd.0 Request processed in 275us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393303.282064:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 38 00000040:00080000:1.0:1787393303.785199:0:14283:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787393303.785209:0:14283:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787393303.785266:0:14283:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787393303.785285:0:14283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787393303.791030:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a82300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14283:1874217338508672:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787393303.791169:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818104300 going to sleep for 11 seconds 00000100:00100000:1.0:1787393303.800079:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a82300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14283:1874217338508672:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787393303.802376:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393303.804501:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319652736 00000100:00100000:1.0:1787393303.804516:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319652736 00000100:00100000:1.0:1787393303.804578:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:1.0:1787393303.804588:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+25:14447:x1874217319652736:12345-192.168.203.21@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787393303.804680:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+25:14447:x1874217319652736:12345-192.168.203.21@tcp:900:lhsmtool_posix.0 Request processed in 92us (2311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393303.804688:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:0.0:1787393303.807342:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393303.809975:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319652864 00000100:00100000:1.0:1787393303.809991:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319652864 00000100:00100000:1.0:1787393303.810060:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:1.0:1787393303.810070:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+25:14447:x1874217319652864:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787393303.810103:0:14250:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787393303.810227:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+25:14447:x1874217319652864:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 157us (2892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393303.810234:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:2.0:1787393303.818678:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393303.818994:0:16377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319652992 00000100:00100000:0.0:1787393303.819005:0:16377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319652992 00000100:00100000:0.0:1787393303.819070:0:16377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 40 00000100:00100000:0.0:1787393303.819080:0:16377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+25:14447:x1874217319652992:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787393303.819160:0:16377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2961 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819176:0:16377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2961 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819200:0:16377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2961 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819238:0:16377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf000/0x19a927d9c62f2968 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819246:0:16377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf000/0x19a927d9c62f2968 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819254:0:16377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf000/0x19a927d9c62f2968 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819288:0:16377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe800/0x19a927d9c62f296f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819297:0:16377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe800/0x19a927d9c62f296f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819304:0:16377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe800/0x19a927d9c62f296f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787393303.819342:0:16377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787393303.819347:0:16377:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787393303.819363:0:16377:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe800/0x19a927d9c62f296f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819374:0:16377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2961 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819381:0:16377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2961 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819398:0:16377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2961 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819405:0:16377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbf200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393303.819410:0:16377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2961 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819418:0:16377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2961 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819430:0:16377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9de8063dad00) 00010000:00010000:0.0:1787393303.819434:0:16377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393303.819438:0:16377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2961 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819568:0:16377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf200/0x19a927d9c62f2961 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819584:0:16377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf000/0x19a927d9c62f2968 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819592:0:16377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf000/0x19a927d9c62f2968 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819597:0:16377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf000/0x19a927d9c62f2968 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819602:0:16377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbf000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393303.819605:0:16377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf000/0x19a927d9c62f2968 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819622:0:16377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf000/0x19a927d9c62f2968 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819632:0:16377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9de807df8d00) 00010000:00010000:0.0:1787393303.819634:0:16377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393303.819637:0:16377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf000/0x19a927d9c62f2968 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819642:0:16377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbf000/0x19a927d9c62f2968 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819656:0:16377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe800/0x19a927d9c62f296f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819663:0:16377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe800/0x19a927d9c62f296f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819669:0:16377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe800/0x19a927d9c62f296f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819674:0:16377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbe800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393303.819677:0:16377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe800/0x19a927d9c62f296f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819683:0:16377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe800/0x19a927d9c62f296f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819689:0:16377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:0.0:1787393303.819692:0:16377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393303.819695:0:16377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe800/0x19a927d9c62f296f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.819708:0:16377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbe800/0x19a927d9c62f296f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393303.819786:0:16377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+25:14447:x1874217319652992:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 Request processed in 706us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393303.819795:0:16377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 40 00000100:00100000:0.0:1787393303.825413:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393303.825481:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319653248 00000100:00100000:1.0:1787393303.825492:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319653248 00000100:00100000:1.0:1787393303.825553:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00100000:1.0:1787393303.825562:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+25:14447:x1874217319653248:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787393303.825593:0:14250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393303.825612:0:14250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8200/0x19a927d9c62f2976 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db66 expref: -99 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.825727:0:14250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f297d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.825740:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f297d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.825752:0:14250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f297d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393303.825763:0:14250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787393303.825943:0:14250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f297d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.825951:0:14250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f297d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.825958:0:14250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f297d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.825971:0:14250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393303.825975:0:14250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f297d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.825983:0:14250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f297d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.825997:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:3.0:1787393303.826000:0:14250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787393303.826004:0:14250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f297d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.826009:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f297d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.826062:0:14250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8200/0x19a927d9c62f2976 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db66 expref: 27 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.826072:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9de8063dad00) 00010000:00010000:3.0:1787393303.826074:0:14250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787393303.826078:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8200/0x19a927d9c62f2976 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db66 expref: 27 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.826088:0:14250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d8200, rc 0) 00000100:00100000:3.0:1787393303.826159:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+26:14447:x1874217319653248:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 597us (753us total) trans 8589934612 rc 301/301 00000100:00100000:3.0:1787393303.826166:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00100000:2.0:1787393303.832879:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393303.833021:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319653376 00000100:00100000:3.0:1787393303.833045:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319653376 00000100:00100000:3.0:1787393303.833104:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:3.0:1787393303.833114:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+26:14447:x1874217319653376:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787393303.833156:0:14249:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787393303.833287:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+26:14447:x1874217319653376:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 173us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393303.833295:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:2.0:1787393303.845115:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393303.845238:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319653632 00000100:00100000:3.0:1787393303.845248:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319653632 00000100:00100000:3.0:1787393303.845330:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:3.0:1787393303.845340:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+26:14447:x1874217319653632:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787393303.845360:0:14250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393303.845379:0:14250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f298b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db6d expref: -99 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787393303.846064:0:14250:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:3.0:1787393303.846072:0:14250:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1787393303.846121:0:14250:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:3.0:1787393303.846409:0:14250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f2992 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.846424:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f2992 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.846435:0:14250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f2992 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.846495:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f298b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db6d expref: 29 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.846528:0:14250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f2992 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db6d expref: 28 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.846537:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9de8063daf00) 00010000:00010000:3.0:1787393303.846540:0:14250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787393303.846543:0:14250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530600, rc 0) 00000100:00100000:3.0:1787393303.846613:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+28:14447:x1874217319653632:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 1273us (1505us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787393303.846621:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:1.0:1787393303.858183:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393303.858307:0:16377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319653888 00000100:00100000:2.0:1787393303.858318:0:16377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319653888 00000100:00100000:2.0:1787393303.858382:0:16377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 44 00000100:00100000:2.0:1787393303.858393:0:16377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+28:14447:x1874217319653888:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787393303.858464:0:16377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787393303.858499:0:16377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f2992 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db6d expref: 28 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858521:0:16377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9de8063daf00) 00010000:00010000:2.0:1787393303.858531:0:16377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787393303.858553:0:16377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f29a0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858566:0:16377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f29a0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858576:0:16377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f29a0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858633:0:16377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f29a7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x31fda213 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858642:0:16377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f29a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x31fda213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858649:0:16377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f29a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x31fda213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858713:0:16377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f29a0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858720:0:16377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f29a0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858726:0:16377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f29a0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858738:0:16377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393303.858742:0:16377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f29a0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858750:0:16377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f29a0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858758:0:16377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9de807df8200) 00010000:00010000:2.0:1787393303.858761:0:16377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393303.858764:0:16377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f29a0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858770:0:16377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5a00/0x19a927d9c62f29a0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858780:0:16377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f29a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x31fda213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858786:0:16377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f29a7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x31fda213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858792:0:16377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f29a7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x31fda213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858797:0:16377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b5600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1787393303.858799:0:16377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f29a7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x31fda213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858805:0:16377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f29a7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x31fda213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858832:0:16377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x31fda213 (ffff9de818bd8100) 00010000:00010000:2.0:1787393303.858834:0:16377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787393303.858882:0:16377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f29a7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x31fda213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393303.858889:0:16377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8186b5600/0x19a927d9c62f29a7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x31fda213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393303.858957:0:16377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+27:14447:x1874217319653888:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 565us (782us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787393303.858965:0:16377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 44 00000100:00100000:2.0:1787393303.864233:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393303.864321:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319654016 00000100:00100000:1.0:1787393303.864331:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319654016 00000100:00100000:1.0:1787393303.864396:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:1.0:1787393303.864404:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+27:14447:x1874217319654016:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787393303.864423:0:14251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393303.864443:0:14251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8600/0x19a927d9c62f29ae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db74 expref: -99 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.864651:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8200/0x19a927d9c62f29b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.864666:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8200/0x19a927d9c62f29b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.864677:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8200/0x19a927d9c62f29b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.864778:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8600/0x19a927d9c62f29ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db74 expref: 29 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.864802:0:14251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8200/0x19a927d9c62f29b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db74 expref: 28 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.864820:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9de7030d6d00) 00010000:00010000:1.0:1787393303.864823:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787393303.864826:0:14251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d8200, rc 0) 00000100:00100000:1.0:1787393303.864919:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+28:14447:x1874217319654016:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 514us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393303.864926:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:0.0:1787393303.869163:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393303.869200:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319654272 00000100:00100000:3.0:1787393303.869211:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319654272 00000100:00100000:3.0:1787393303.869277:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00100000:3.0:1787393303.869287:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de835254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+28:14447:x1874217319654272:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787393303.869555:0:14249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29bc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.869573:0:14249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.869585:0:14249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787393303.870067:0:14249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1787393303.870078:0:14249:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 453045238118ns, next at 454045236018ns, rc = 0 00000004:00010000:3.0:1787393303.870187:0:14249:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000274bd31a reply state 0000000077f06da6 transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393303.870215:0:14249:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787393303.871307:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de835254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+30:14447:x1874217319654272:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 2013us (2145us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1787393303.871432:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 46 00010000:00010000:1.0:1787393303.880435:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393303.880437:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00010000:00010000:1.0:1787393303.880448:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29bc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.880456:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29bc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.880462:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1787393303.880466:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29bc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.880481:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29bc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.880497:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9de7030d6d00) 00010000:00010000:1.0:1787393303.880501:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787393303.880505:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29bc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.880528:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29bc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393303.880785:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319654400 00000100:00100000:3.0:1787393303.880794:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319654400 00000100:00100000:3.0:1787393303.880882:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:3.0:1787393303.880893:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+29:14447:x1874217319654400:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787393303.880914:0:14250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393303.880931:0:14250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530a00/0x19a927d9c62f29c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db7b expref: -99 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.880984:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530a00/0x19a927d9c62f29c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db7b expref: 30 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.880997:0:14250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530a00/0x19a927d9c62f29c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db7b expref: 30 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.881014:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9de7030d6d00) 00010000:00010000:3.0:1787393303.881017:0:14250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787393303.881019:0:14250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530a00, rc 0) 00000100:00100000:3.0:1787393303.881077:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+30:14447:x1874217319654400:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 186us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393303.881085:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:2.0:1787393303.884786:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393303.884967:0:16176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319654528 00000100:00100000:3.0:1787393303.884978:0:16176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319654528 00000100:00100000:3.0:1787393303.885089:0:16176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:3.0:1787393303.885101:0:16176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+5:2355:x1874217319654528:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787393303.885650:0:16176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:2355:x1874217319654528:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 549us (870us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787393303.885660:0:16176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00080000:0.0:1787393303.885870:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787393303.897726:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393303.897920:0:14253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319654784 00000100:00100000:0.0:1787393303.897930:0:14253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319654784 00000100:00100000:0.0:1787393303.897991:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:0.0:1787393303.898002:0:14253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+30:14447:x1874217319654784:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787393303.898251:0:14253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+31:14447:x1874217319654784:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 251us (534us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787393303.898267:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:2.0:1787393303.903416:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393303.903613:0:16377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319655040 00000100:00100000:0.0:1787393303.903622:0:16377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319655040 00000100:00100000:0.0:1787393303.903675:0:16377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:0.0:1787393303.903683:0:16377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+31:14447:x1874217319655040:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787393303.903778:0:16377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+31:14447:x1874217319655040:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 96us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393303.903785:0:16377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:3.0:1787393303.907952:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393303.908059:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319655168 00000100:00100000:1.0:1787393303.908069:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319655168 00000100:00100000:1.0:1787393303.908124:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:1.0:1787393303.908143:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+31:14447:x1874217319655168:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787393303.908162:0:14251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393303.908182:0:14251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8600/0x19a927d9c62f29ca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db82 expref: -99 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.908253:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f29d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.908266:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f29d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.908276:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f29d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787393303.908322:0:14251:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787393303.908340:0:14251:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f29d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.908366:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d8600/0x19a927d9c62f29ca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db82 expref: 33 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.908384:0:14251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f29d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db82 expref: 32 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.908411:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9de7030d6d00) 00010000:00010000:1.0:1787393303.908414:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787393303.908418:0:14251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d9e00, rc 0) 00000100:00100000:1.0:1787393303.908487:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+32:14447:x1874217319655168:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 354us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393303.908494:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:2.0:1787393303.914478:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393303.914614:0:14887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319655296 00000100:00100000:3.0:1787393303.914626:0:14887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319655296 00000100:00100000:3.0:1787393303.914685:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:3.0:1787393303.914695:0:14887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+6:2356:x1874217319655296:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787393303.914713:0:14887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787393303.914732:0:14887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db89 expref: -99 pid: 14887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787393303.914758:0:14887:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a897518, blocks: 0x1 00010000:00010000:3.0:1787393303.914776:0:14887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787393303.914780:0:14887:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393303.914789:0:14887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db89 expref: 7 pid: 14887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.914807:0:14887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db89 expref: 7 pid: 14887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.914821:0:14887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de801530000, rc 0) 00000100:00100000:3.0:1787393303.914903:0:14887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+7:2356:x1874217319655296:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 209us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393303.914924:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:2.0:1787393303.920196:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393303.920224:0:16377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319655552 00000100:00100000:0.0:1787393303.920244:0:16377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319655552 00000100:00100000:0.0:1787393303.920307:0:16377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:0.0:1787393303.920326:0:16377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f5f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+32:14447:x1874217319655552:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787393303.921080:0:16377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f5f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+32:14447:x1874217319655552:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 752us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393303.921090:0:16377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:3.0:1787393303.927571:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393303.927608:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319655680 00000100:00100000:3.0:1787393303.927619:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319655680 00000100:00100000:3.0:1787393303.927674:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:3.0:1787393303.927684:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+32:14447:x1874217319655680:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787393303.956729:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+32:14447:x1874217319655680:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 Request processed in 29036us (29156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393303.956743:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 51 00000001:00080000:1.0:1787393303.956826:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000001:00080000:1.0:1787393303.956878:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1787393303.956914:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:1.0:1787393303.956928:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787393303.957112:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787393303.957127:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8089f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338508800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787393303.957193:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393303.957314:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338508800 00000100:00100000:1.0:1787393303.957323:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338508800 00000100:00100000:1.0:1787393303.957387:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787393303.957395:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1874217338508800:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1787393303.957539:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1787393303.957671:0:14884:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787393303.957675:0:14884:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787393303.957677:0:14884:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787393303.957679:0:14884:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787393304 -> 1787393304 00002000:00010000:1.0:1787393303.957682:0:14884:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787393303.957769:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3327:x1874217338508800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 374us (576us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787393303.957776:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1787393303.960633:0:3327:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9de8089f0380/2, rc 0, transno 8589934595 00000100:00100000:3.0:1787393303.960648:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8089f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1874217338508800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787393303.960722:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393303.960811:0:14887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319655808 00000100:00100000:3.0:1787393303.960818:0:14887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319655808 00000100:00100000:3.0:1787393303.960883:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:3.0:1787393303.960891:0:14887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+7:2356:x1874217319655808:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787393303.960992:0:14887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+7:2356:x1874217319655808:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 Request processed in 100us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393303.961024:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:0.0:1787393303.964534:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393303.964682:0:16377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319656064 00000100:00100000:3.0:1787393303.964693:0:16377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319656064 00000100:00100000:3.0:1787393303.964753:0:16377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00100000:3.0:1787393303.964765:0:16377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+14:14447:x1874217319656064:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787393303.964817:0:16377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393303.964876:0:16377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9e00/0x19a927d9c62f29d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db82 expref: 14 pid: 14251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.964896:0:16377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9de7030d6d00) 00010000:00010000:3.0:1787393303.964902:0:16377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787393303.964932:0:16377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29df lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.964945:0:16377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.964954:0:16377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787393303.965162:0:16377:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000395b84ec reply state 00000000722af66f transno 8589934616 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393303.965172:0:16377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787393303.965271:0:16377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+15:14447:x1874217319656064:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 498us (734us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1787393303.965279:0:16377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 52 00010000:00010000:0.0:1787393303.969549:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.969565:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29df lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.969571:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29df lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.969577:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1787393303.969582:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29df lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.969588:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29df lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.969605:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9de7030d6d00) 00010000:00010000:0.0:1787393303.969608:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787393303.969612:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29df lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.969618:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29df lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393303.970662:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393303.970736:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319656192 00000100:00100000:1.0:1787393303.970746:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319656192 00000100:00100000:1.0:1787393303.970802:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:1.0:1787393303.970812:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+7:14447:x1874217319656192:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787393303.970873:0:14884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787393303.970891:0:14884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f29e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x539bd5f49fa0db90 expref: -99 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.970920:0:14884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db89 expref: 8 pid: 14887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.970929:0:14884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393303.970933:0:14884:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393303.970938:0:14884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f29e6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db90 expref: 8 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.970968:0:14884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db89 expref: 8 pid: 14887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.970982:0:14884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db89 expref: 8 pid: 14887 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393303.970997:0:14884:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14884:1874217338508928:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787393303.971077:0:14884:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de818104300 going to sleep for 11 seconds 00000100:00100000:2.0:1787393303.975685:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393303.975800:0:14884:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14884:1874217338508928:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787393303.975833:0:14884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f29e6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db90 expref: 8 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393303.975886:0:14884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9de8040d8600, rc 0) 00000100:00100000:1.0:1787393303.975952:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+8:14447:x1874217319656192:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 5140us (5297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393303.975962:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:3.0:1787393303.976187:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319656320 00000100:00100000:3.0:1787393303.976201:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319656320 00010000:00010000:3.0:1787393303.976232:0:14236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db89 expref: 8 pid: 14887 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393303.976272:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:3.0:1787393303.976280:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f68b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+8:2355:x1874217319656320:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787393303.976302:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787393303.976332:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db89 expref: 8 pid: 14887 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.976345:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db89 expref: 8 pid: 14887 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.976366:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db89 expref: 8 pid: 14887 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.976381:0:14236:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393303.976385:0:14236:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393303.976391:0:14236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f29e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db90 expref: 7 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.976399:0:14236:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f29e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db90 expref: 7 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.976433:0:14236:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f29e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db90 expref: 7 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393303.976698:0:14236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8089f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14236:1874217338509056:192.168.203.21@tcp:105: 00000100:00100000:3.0:1787393303.976771:0:14236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80b036c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787393303.981297:0:14236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8089f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14236:1874217338509056:192.168.203.21@tcp:105: 00010000:00010000:3.0:1787393303.981326:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787393303.981432:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f68b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+7:2355:x1874217319656320:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 5150us (5754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393303.981450:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:2.0:1787393303.984056:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393303.984582:0:14887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319656448 00000100:00100000:3.0:1787393303.984594:0:14887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319656448 00000100:00100000:3.0:1787393303.984647:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:3.0:1787393303.984656:0:14887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f68b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+7:2355:x1874217319656448:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787393303.984870:0:14887:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787393303.984874:0:14887:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787393303 00002000:00010000:3.0:1787393303.984877:0:14887:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787393302 00002000:00010000:3.0:1787393303.984879:0:14887:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787393304 -> 1787393303 00002000:00010000:3.0:1787393303.984881:0:14887:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787393303.984925:0:14887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f68b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+8:2355:x1874217319656448:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 270us (878us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787393303.984933:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:2.0:1787393303.989887:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393303.989981:0:16176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319656576 00000100:00100000:3.0:1787393303.989991:0:16176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319656576 00000100:00100000:3.0:1787393303.990245:0:16176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:3.0:1787393303.990257:0:16176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+8:2356:x1874217319656576:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787393303.990431:0:16176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29ed lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.990521:0:16176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f29e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db90 expref: 8 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.990531:0:16176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393303.990536:0:16176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787393303.990540:0:16176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29ed lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.990575:0:16176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f29e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db90 expref: 8 pid: 14884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.990590:0:16176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f29e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db90 expref: 8 pid: 14884 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393303.990606:0:16176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8089f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16176:1874217338509184:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393303.990690:0:16176:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80b036c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787393303.994761:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393303.994918:0:16176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8089f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16176:1874217338509184:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393303.994945:0:16176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29ed lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393303.995026:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319656704 00000100:00100000:0.0:1787393303.995033:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319656704 00010000:00010000:0.0:1787393303.995078:0:14235:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f29e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db90 expref: 9 pid: 14884 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393303.995114:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:0.0:1787393303.995122:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f689500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+9:2356:x1874217319656704:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787393303.995146:0:14235:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787393303.995167:0:14235:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f29e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db90 expref: 9 pid: 14884 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.995179:0:14235:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f29e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db90 expref: 9 pid: 14884 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.995201:0:14235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004188073b/0x19a927d9c62f29e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db90 expref: 9 pid: 14884 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.995216:0:14235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787393303.995220:0:14235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787393303.995226:0:14235:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.995235:0:14235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29ed lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393303.995277:0:14235:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787393303.995571:0:16176:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.995593:0:16176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.995619:0:16176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.995628:0:16176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.995638:0:16176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.995646:0:16176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530000 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393303.995651:0:16176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.995659:0:16176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.995672:0:16176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.995680:0:16176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008326ad9c/0x19a927d9c62f29ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393303.995775:0:16176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+8:2356:x1874217319656576:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 Request processed in 5519us (5898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393303.995784:0:16176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:0.0:1787393303.995891:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f689500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+7:2356:x1874217319656704:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 768us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393303.995909:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:0.0:1787393303.999076:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393303.999166:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319656960 00000100:00100000:3.0:1787393303.999175:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319656960 00000100:00100000:3.0:1787393303.999269:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 53 00000100:00100000:3.0:1787393303.999280:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+14:14447:x1874217319656960:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787393303.999381:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29f4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.999398:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.999410:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.999827:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29fb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.999865:0:14251:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530a00/0x19a927d9c62f29c3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db7b expref: 15 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.999874:0:14251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29fb lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.999905:0:14251:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530a00/0x19a927d9c62f29c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db7b expref: 15 pid: 14250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393303.999929:0:14251:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530a00/0x19a927d9c62f29c3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db7b expref: 15 pid: 14250 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393303.999944:0:14251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8089f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14251:1874217338509312:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787393304.000082:0:14251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80b036c00 going to sleep for 10 seconds 00000100:00100000:2.0:1787393304.005020:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393304.005086:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319657088 00000100:00100000:1.0:1787393304.005095:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319657088 00010000:00010000:1.0:1787393304.005129:0:14236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530a00/0x19a927d9c62f29c3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db7b expref: 16 pid: 14250 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393304.005174:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:1.0:1787393304.005182:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f68aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+16:2355:x1874217319657088:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787393304.005195:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787393304.005202:0:14236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530a00/0x19a927d9c62f29c3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db7b expref: 16 pid: 14250 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.005214:0:14236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530a00/0x19a927d9c62f29c3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db7b expref: 16 pid: 14250 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.005234:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9de7030d6d00) 00010000:00010000:1.0:1787393304.005239:0:14236:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29fb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.005248:0:14236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.005255:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29fb lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.005280:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787393304.005332:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f68aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+16:2355:x1874217319657088:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 150us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393304.005355:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00010000:00010000:3.0:1787393304.006658:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530a00/0x19a927d9c62f29c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db7b expref: 15 pid: 14250 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393304.006681:0:14251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8089f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14251:1874217338509312:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787393304.006702:0:14251:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.006811:0:14251:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.006818:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787393304.007151:0:14251:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1787393304.007601:0:14251:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000001:00080000:1.0:1787393304.007648:0:14251:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1787393304.007720:0:14251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14251:1874217338509440:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787393304.007820:0:14251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393304.007973:0:14251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de83fa72000 going to sleep for 11 seconds 00000100:00100000:2.0:1787393304.008110:0:14254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338509440 00000100:00100000:2.0:1787393304.008118:0:14254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338509440 00000100:00100000:2.0:1787393304.008200:0:14254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787393304.008209:0:14254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14251:x1874217338509440:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787393304.008305:0:14254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14251:x1874217338509440:12345-0@lo:1000:mdt00_002.0 Request processed in 97us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393304.008318:0:14254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787393304.008374:0:14251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14251:1874217338509440:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787393304.009019:0:14251:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934620 00000100:00100000:1.0:1787393304.009082:0:14251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de702a80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14251:1874217338509568:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787393304.009116:0:14251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393304.011696:0:14254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338509568 00000100:00100000:1.0:1787393304.011707:0:14251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de827b33cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787393304.011714:0:14254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338509568 00000100:00100000:2.0:1787393304.011791:0:14254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787393304.011801:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787393304.011806:0:14254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14251:x1874217338509568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787393304.011811:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1787393304.012395:0:14254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14251:x1874217338509568:12345-0@lo:1000:mdt00_002.0 Request processed in 593us (3275us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787393304.012404:0:14254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787393304.012549:0:14251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de702a80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14251:1874217338509568:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787393304.012592:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.012602:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29fb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.012610:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29fb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.012616:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393304.012620:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29fb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.012628:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29fb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.012651:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9de7030d6d00) 00010000:00010000:3.0:1787393304.012655:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787393304.012660:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29fb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.012666:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531c00/0x19a927d9c62f29fb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.012821:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9a00/0x19a927d9c62f2953 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.012829:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9a00/0x19a927d9c62f2953 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.012834:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9a00/0x19a927d9c62f2953 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.012962:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393304.012966:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9a00/0x19a927d9c62f2953 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.012973:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9a00/0x19a927d9c62f2953 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.012982:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:3.0:1787393304.012985:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787393304.012993:0:14251:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f295a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db5f expref: 18 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.013086:0:14251:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f295a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db5f expref: 18 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.013105:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f295a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db5f expref: 18 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.013153:0:14251:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531a00/0x19a927d9c62f295a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x539bd5f49fa0db5f expref: 18 pid: 14249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393304.013168:0:14251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de8089f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14251:1874217338509696:192.168.203.21@tcp:105: 00000100:00100000:3.0:1787393304.013405:0:14251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9de80b036c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787393304.020677:0:14251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de8089f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14251:1874217338509696:192.168.203.21@tcp:105: 00010000:00010000:3.0:1787393304.020706:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9a00/0x19a927d9c62f2953 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.020717:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de8040d9a00/0x19a927d9c62f2953 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.020752:0:14251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f2a02 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.020765:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f2a02 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.020776:0:14251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f2a02 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.020791:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f2a02 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.020797:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f2a02 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.020815:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f2a02 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.020821:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1787393304.020825:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f2a02 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.020832:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f2a02 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.020874:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:3.0:1787393304.020878:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787393304.020881:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f2a02 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.020895:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801530600/0x19a927d9c62f2a02 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.022886:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.022908:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29f4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.022915:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.022920:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531000 already unused, calling callback (ffffffffc20fc4f0) 00000100:00100000:1.0:1787393304.022947:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00010000:00010000:3.0:1787393304.022980:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393304.023044:0:14252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319657216 00000100:00100000:2.0:1787393304.023054:0:14252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319657216 00010000:00010000:3.0:1787393304.023147:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29f4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.023163:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9de807df8a00) 00010000:00010000:3.0:1787393304.023166:0:14251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787393304.023171:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29f4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393304.023175:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00010000:00010000:3.0:1787393304.023178:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de801531000/0x19a927d9c62f29f4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14251 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393304.023185:0:14252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c004850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+19:14445:x1874217319657216:12345-192.168.203.21@tcp:49:dd.0 00000100:00100000:2.0:1787393304.023329:0:14252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c004850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+19:14445:x1874217319657216:12345-192.168.203.21@tcp:49:dd.0 Request processed in 145us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393304.023336:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000040:00080000:1.0:1787393304.024735:0:14283:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787393304.024743:0:14283:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787393304.024794:0:14283:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787393304.024799:0:14283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787393304.024873:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f99b078-55e6-49ce-aa7b-246ff01aefa1+18:14447:x1874217319656960:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 25590us (25800us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1787393304.024884:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 53 00000020:00080000:3.0:1787393304.024890:0:14251:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787393304.038776:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787393304.038869:0:14253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319657472 00000100:00100000:0.0:1787393304.038879:0:14253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319657472 00000100:00100000:0.0:1787393304.038935:0:14253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:0.0:1787393304.038945:0:14253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de702a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+18:14447:x1874217319657472:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787393304.039754:0:14253:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787393304.039908:0:14253:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934622 00010000:00010000:0.0:1787393304.039957:0:14253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2a09 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393304.039973:0:14253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2a09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393304.039985:0:14253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2a09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393304.039993:0:14253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2a09 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393304.040000:0:14253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2a09 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393304.040006:0:14253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2a09 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393304.040029:0:14253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787393304.040119:0:14253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de702a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f99b078-55e6-49ce-aa7b-246ff01aefa1+20:14447:x1874217319657472:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 1172us (1349us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1787393304.040149:0:14253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000020:00080000:0.0:1787393304.040155:0:14253:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787393304.040173:0:14238:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787393304.040182:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2a09 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.040192:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbfe00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393304.040196:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2a09 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.040272:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2a09 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.040297:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9de7030d6d00) 00010000:00010000:2.0:1787393304.040300:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787393304.040305:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2a09 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.040312:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9de82ffbfe00/0x19a927d9c62f2a09 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.040328:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393304.040330:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393304.040331:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787393304.232501:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787393304.239366:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393304.239579:0:14890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319657600 00000100:00100000:1.0:1787393304.239593:0:14890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319657600 00000100:00100000:1.0:1787393304.239696:0:14890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:1.0:1787393304.239709:0:14890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+7:2355:x1874217319657600:12345-192.168.203.21@tcp:4:dd.0 00002000:00010000:1.0:1787393304.239775:0:14890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a897517, atime: 0x6a897516, ctime: 0x6a897517, blocks: 0x1 00010000:00010000:1.0:1787393304.239799:0:14890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f2a10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.239820:0:14890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1787393304.239826:0:14890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393304.239944:0:14890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f2a10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.239964:0:14890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f2a10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393304.248495:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393304.248617:0:14892:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787393304.248645:0:14892:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787393304.253364:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393304.253959:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393304.253985:0:14891:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787393304.254003:0:14891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319657728 00000100:00100000:2.0:1787393304.254013:0:14891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319657728 00000100:00100000:2.0:1787393304.254058:0:14891:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787393304.254064:0:14891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319657856 00000100:00100000:2.0:1787393304.254067:0:14891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319657856 00000100:00100000:2.0:1787393304.254081:0:14891:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787393304.254084:0:14891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319657984 00000100:00100000:2.0:1787393304.254086:0:14891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319657984 00000100:00100000:0.0:1787393304.254887:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393304.254916:0:14891:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787393304.254929:0:14891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319658112 00000100:00100000:2.0:1787393304.254935:0:14891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319658112 00000100:00100000:3.0:1787393304.258228:0:16379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:3.0:1787393304.258251:0:16379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+12:2355:x1874217319657728:12345-192.168.203.21@tcp:4:dd.0 00010000:00010000:3.0:1787393304.258309:0:16379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076aa4c69/0x19a927d9c62f2a17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.258332:0:16379:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393304.258338:0:16379:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393304.258345:0:16379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076aa4c69/0x19a927d9c62f2a17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.258363:0:16379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076aa4c69/0x19a927d9c62f2a17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393304.274097:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393304.274172:0:14892:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787393304.274189:0:14892:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1787393304.276639:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393304.276817:0:14892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319658240 00000100:00100000:3.0:1787393304.276827:0:14892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319658240 00000100:00100000:3.0:1787393304.276913:0:14892:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787393304.276921:0:14892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319658368 00000100:00100000:3.0:1787393304.276924:0:14892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319658368 00000100:00100000:3.0:1787393304.277479:0:16380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:3.0:1787393304.277490:0:16380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7f99b078-55e6-49ce-aa7b-246ff01aefa1+15:2356:x1874217319657856:12345-192.168.203.21@tcp:4:dd.0 00010000:00010000:3.0:1787393304.277525:0:16380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ab8ff9b/0x19a927d9c62f2a1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.277541:0:16380:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393304.277544:0:16380:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393304.277551:0:16380:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ab8ff9b/0x19a927d9c62f2a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.277564:0:16380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ab8ff9b/0x19a927d9c62f2a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393304.284650:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787393304.284784:0:14892:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1787393304.284794:0:14892:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1787393304.295800:0:14892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319658496 00000100:00100000:0.0:1787393304.295814:0:14892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319658496 00000100:00100000:0.0:1787393304.296405:0:16381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:0.0:1787393304.296418:0:16381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7f99b078-55e6-49ce-aa7b-246ff01aefa1+17:2356:x1874217319657984:12345-192.168.203.21@tcp:4:dd.0 00010000:00010000:0.0:1787393304.296454:0:16381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001531c079/0x19a927d9c62f2a25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393304.296472:0:16381:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393304.296476:0:16381:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393304.296483:0:16381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001531c079/0x19a927d9c62f2a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393304.296497:0:16381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001531c079/0x19a927d9c62f2a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787393304.398822:0:14890:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1787393304.398863:0:14890:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787393303 -> 1787393304 00002000:00010000:2.0:1787393304.398865:0:14890:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787393303 -> 1787393304 00002000:00010000:2.0:1787393304.398868:0:14890:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:2.0:1787393304.398882:0:14890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f2a10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.398893:0:14890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f2a10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.398914:0:14890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f2a10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.398922:0:14890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d8800 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393304.398927:0:14890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f2a10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.398935:0:14890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f2a10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.398953:0:14890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f2a10 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.398961:0:14890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d104381/0x19a927d9c62f2a10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393304.399051:0:14890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+25:2355:x1874217319657600:12345-192.168.203.21@tcp:4:dd.0 Request processed in 159341us (159696us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787393304.399061:0:14890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:2.0:1787393304.399098:0:14890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:2.0:1787393304.399109:0:14890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8012adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+24:2355:x1874217319658112:12345-192.168.203.21@tcp:4:dd.0 00010000:00010000:2.0:1787393304.399157:0:14890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f12f4541/0x19a927d9c62f2a2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.399169:0:14890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787393304.399173:0:14890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787393304.399179:0:14890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f12f4541/0x19a927d9c62f2a2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.399190:0:14890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f12f4541/0x19a927d9c62f2a2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393304.400281:0:16379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076aa4c69/0x19a927d9c62f2a17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393304.400297:0:16379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076aa4c69/0x19a927d9c62f2a17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393304.400305:0:16379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076aa4c69/0x19a927d9c62f2a17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393304.400322:0:16379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531000 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:0.0:1787393304.400326:0:16379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076aa4c69/0x19a927d9c62f2a17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393304.400336:0:16379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076aa4c69/0x19a927d9c62f2a17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393304.400350:0:16379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076aa4c69/0x19a927d9c62f2a17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393304.400358:0:16379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076aa4c69/0x19a927d9c62f2a17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787393304.400417:0:16379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+24:2355:x1874217319657728:12345-192.168.203.21@tcp:4:dd.0 Request processed in 142172us (151933us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787393304.400425:0:16379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:0.0:1787393304.400448:0:16379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:0.0:1787393304.400456:0:16379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+23:2355:x1874217319658240:12345-192.168.203.21@tcp:4:dd.0 00010000:00010000:0.0:1787393304.400478:0:16379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fcc8091/0x19a927d9c62f2a33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393304.400488:0:16379:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393304.400492:0:16379:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787393304.400497:0:16379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fcc8091/0x19a927d9c62f2a33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787393304.400518:0:16379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fcc8091/0x19a927d9c62f2a33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787393304.400581:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1787393304.400592:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:0.0:1787393304.400609:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:0.0:1787393304.400615:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:1.0:1787393304.410561:0:16381:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1787393304.410583:0:16381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001531c079/0x19a927d9c62f2a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.410596:0:16381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001531c079/0x19a927d9c62f2a25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.410605:0:16381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001531c079/0x19a927d9c62f2a25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.410631:0:16381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbe200 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:1.0:1787393304.410635:0:16381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001531c079/0x19a927d9c62f2a25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.410645:0:16381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001531c079/0x19a927d9c62f2a25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.410665:0:16381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001531c079/0x19a927d9c62f2a25 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.410672:0:16381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001531c079/0x19a927d9c62f2a25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393304.410763:0:16381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7f99b078-55e6-49ce-aa7b-246ff01aefa1+14:2356:x1874217319657984:12345-192.168.203.21@tcp:4:dd.0 Request processed in 114344us (156800us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787393304.410772:0:16381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:1.0:1787393304.410802:0:16381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:1.0:1787393304.410815:0:16381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f68b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7f99b078-55e6-49ce-aa7b-246ff01aefa1+13:2356:x1874217319658368:12345-192.168.203.21@tcp:4:dd.0 00010000:00010000:1.0:1787393304.410864:0:16381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f2a3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.410877:0:16381:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393304.410882:0:16381:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787393304.410888:0:16381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f2a3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.410914:0:16381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f2a3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787393304.482057:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:3.0:1787393304.487067:0:16380:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 7340032 00002000:00010000:3.0:1787393304.487078:0:16380:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:3.0:1787393304.487093:0:16380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ab8ff9b/0x19a927d9c62f2a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.487106:0:16380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ab8ff9b/0x19a927d9c62f2a1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.487142:0:16380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ab8ff9b/0x19a927d9c62f2a1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.487150:0:16380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801530600 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:3.0:1787393304.487155:0:16380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ab8ff9b/0x19a927d9c62f2a1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.487163:0:16380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ab8ff9b/0x19a927d9c62f2a1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.487184:0:16380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ab8ff9b/0x19a927d9c62f2a1e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.487192:0:16380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ab8ff9b/0x19a927d9c62f2a1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787393304.488423:0:16380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7f99b078-55e6-49ce-aa7b-246ff01aefa1+18:2356:x1874217319657856:12345-192.168.203.21@tcp:4:dd.0 Request processed in 210926us (235059us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787393304.488434:0:16380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:3.0:1787393304.488464:0:16380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:3.0:1787393304.488475:0:16380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83c5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7f99b078-55e6-49ce-aa7b-246ff01aefa1+17:2356:x1874217319658496:12345-192.168.203.21@tcp:4:dd.0 00010000:00010000:3.0:1787393304.488507:0:16380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003934a5f6/0x19a927d9c62f2a41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.488522:0:16380:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393304.488532:0:16380:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787393304.488538:0:16380:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003934a5f6/0x19a927d9c62f2a41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787393304.488551:0:16380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003934a5f6/0x19a927d9c62f2a41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787393304.536733:0:16381:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:1.0:1787393304.536755:0:16381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f2a3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.536768:0:16381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f2a3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.536777:0:16381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f2a3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.536785:0:16381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8040d9400 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:1.0:1787393304.536790:0:16381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f2a3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.536799:0:16381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f2a3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.536819:0:16381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f2a3a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.536826:0:16381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffe7d33e/0x19a927d9c62f2a3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393304.536963:0:16381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f68b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7f99b078-55e6-49ce-aa7b-246ff01aefa1+19:2356:x1874217319658368:12345-192.168.203.21@tcp:4:dd.0 Request processed in 126148us (260329us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787393304.536974:0:16381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000001:00080000:1.0:1787393304.538408:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00010000:00010000:1.0:1787393304.538476:0:16379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fcc8091/0x19a927d9c62f2a33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.538488:0:16379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fcc8091/0x19a927d9c62f2a33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.538495:0:16379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fcc8091/0x19a927d9c62f2a33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.538502:0:16379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de82ffbf400 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:1.0:1787393304.538507:0:16379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fcc8091/0x19a927d9c62f2a33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.538515:0:16379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fcc8091/0x19a927d9c62f2a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.538532:0:16379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fcc8091/0x19a927d9c62f2a33 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.538539:0:16379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fcc8091/0x19a927d9c62f2a33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393304.538626:0:16379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+11:2355:x1874217319658240:12345-192.168.203.21@tcp:4:dd.0 Request processed in 138168us (264535us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787393304.538635:0:16379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00010000:00010000:2.0:1787393304.540806:0:14890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f12f4541/0x19a927d9c62f2a2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.540827:0:14890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f12f4541/0x19a927d9c62f2a2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.540867:0:14890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f12f4541/0x19a927d9c62f2a2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.540876:0:14890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de8186b4e00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:2.0:1787393304.540881:0:14890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f12f4541/0x19a927d9c62f2a2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.540889:0:14890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f12f4541/0x19a927d9c62f2a2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.540921:0:14890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f12f4541/0x19a927d9c62f2a2c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787393304.540929:0:14890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f12f4541/0x19a927d9c62f2a2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787393304.541080:0:14890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8012adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+9:2355:x1874217319658112:12345-192.168.203.21@tcp:4:dd.0 Request processed in 141969us (286243us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1787393304.541090:0:14890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00000001:00080000:2.0:1787393304.583750:0:7527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:1.0:1787393304.584452:0:16380:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1787393304.584468:0:16380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003934a5f6/0x19a927d9c62f2a41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.584482:0:16380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003934a5f6/0x19a927d9c62f2a41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.584491:0:16380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003934a5f6/0x19a927d9c62f2a41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.584498:0:16380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9de801531c00 already unused, calling callback (ffffffffc16c0e90) 00010000:00010000:1.0:1787393304.584503:0:16380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003934a5f6/0x19a927d9c62f2a41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.584512:0:16380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003934a5f6/0x19a927d9c62f2a41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.584530:0:16380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003934a5f6/0x19a927d9c62f2a41 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787393304.584537:0:16380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003934a5f6/0x19a927d9c62f2a41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787393304.584685:0:16380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83c5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7f99b078-55e6-49ce-aa7b-246ff01aefa1+5:2356:x1874217319658496:12345-192.168.203.21@tcp:4:dd.0 Request processed in 96209us (300040us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787393304.584695:0:16380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00010000:00010000:2.0:1787393305.256576:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787393305.448268:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787393305.448291:0:3326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338509824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787393305.448355:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787393305.448468:0:14888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338509824 00000100:00100000:1.0:1787393305.448476:0:14888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338509824 00000100:00100000:1.0:1787393305.448540:0:14888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787393305.448551:0:14888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f68ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338509824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787393305.448572:0:14888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:1.0:1787393305.448617:0:14888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f68ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1874217338509824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393305.448624:0:14888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787393305.448714:0:3326:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1787393305.448720:0:3326:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9de8089f0380, transno 8589934595 00000004:00080000:2.0:1787393305.448738:0:3326:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1787393305.448769:0:3326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1874217338509824:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787393305.449418:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787393305.449589:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338510336:0@lo:400:kworker.0 00000100:00100000:3.0:1787393305.449631:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787393305.449665:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787393305.449672:0:3327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338510208:0@lo:400:kworker.0 00000100:00100000:3.0:1787393305.449692:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393305.449762:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338510080:0@lo:400:kworker.0 00000100:00100000:2.0:1787393305.449801:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393305.449828:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787393305.449834:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de835328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3325:1874217338509952:0@lo:400:kworker.0 00000100:00100000:2.0:1787393305.449879:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393305.449901:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de834d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338510464:0@lo:400:kworker.0 00000100:00100000:2.0:1787393305.449934:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393305.449959:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338510336 00000100:00100000:2.0:1787393305.449964:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338510336 00000100:00100000:2.0:1787393305.449998:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338510208 00000100:00100000:2.0:1787393305.450001:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338510208 00000100:00100000:2.0:1787393305.450014:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338510464 00000100:00100000:2.0:1787393305.450016:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338510464 00000100:00100000:2.0:1787393305.450033:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787393305.450039:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338510336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393305.450079:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1874217338510336:12345-0@lo:400:kworker.0 Request processed in 40us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393305.450085:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787393305.450101:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787393305.450106:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338510208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393305.450145:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1874217338510208:12345-0@lo:400:kworker.0 Request processed in 38us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393305.450155:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787393305.450165:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787393305.450170:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338510464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787393305.450200:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1874217338510464:12345-0@lo:400:kworker.0 Request processed in 30us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393305.450206:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787393305.450235:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1874217338510464:0@lo:400:kworker.0 00000100:00100000:0.0:1787393305.450372:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338509952 00000100:00100000:0.0:1787393305.450377:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338509952 00000100:00100000:0.0:1787393305.450411:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787393305.450419:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8181fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:3325:x1874217338509952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787393305.450457:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8181fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:529eca5c-3a2f-4c24-8f17-b3e707cfe67a+19:3325:x1874217338509952:12345-0@lo:400:kworker.0 Request processed in 40us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393305.450464:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1787393305.450493:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393305.450509:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de835328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:529eca5c-3a2f-4c24-8f17-b3e707cfe67a:3325:1874217338509952:0@lo:400:kworker.0 00000100:00100000:3.0:1787393305.450623:0:14887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338510080 00000100:00100000:3.0:1787393305.450628:0:14887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338510080 00000100:00100000:3.0:1787393305.450678:0:14887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787393305.450686:0:14887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de83f689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338510080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787393305.450725:0:14887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de83f689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1874217338510080:12345-0@lo:400:kworker.0 Request processed in 41us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393305.450731:0:14887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787393305.450763:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1874217338510208:0@lo:400:kworker.0 00000100:00100000:3.0:1787393305.450786:0:3327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1874217338510336:0@lo:400:kworker.0 00000100:00100000:3.0:1787393305.450812:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de834d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1874217338510080:0@lo:400:kworker.0 00000100:00080000:0.0:1787393305.451156:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787393305.964895:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787393305.964919:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9de83f68a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338510592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787393305.964988:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787393305.965090:0:14888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217338510592 00000100:00100000:2.0:1787393305.965099:0:14888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217338510592 00000100:00100000:2.0:1787393305.965156:0:14888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787393305.965165:0:14888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de834d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338510592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787393305.965209:0:14888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787393305.965267:0:14888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de834d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1874217338510592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393305.965274:0:14888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787393305.965482:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9de83f68a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1874217338510592:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787393306.280558:0:14237:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787393306.409084:0:16421:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1787393306.968394:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787393306.968667:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319658752 00000100:00100000:2.0:1787393306.968677:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319658752 00000100:00100000:2.0:1787393306.968762:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:2.0:1787393306.968774:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+20:2354:x1874217319658752:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393306.968871:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+20:2354:x1874217319658752:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 99us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393306.968879:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:3.0:1787393306.969301:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393306.969334:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393306.969376:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393306.969397:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393306.969414:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393306.969662:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787393306.969688:0:16176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319659008 00000100:00100000:3.0:1787393306.969694:0:16176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319659008 00000100:00100000:3.0:1787393306.969725:0:16176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319659264 00000100:00100000:3.0:1787393306.969728:0:16176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319659264 00000100:00100000:3.0:1787393306.969740:0:16176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319658880 00000100:00100000:3.0:1787393306.969742:0:16176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319658880 00000100:00100000:3.0:1787393306.969754:0:16176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319659392 00000100:00100000:3.0:1787393306.969756:0:16176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319659392 00000100:00100000:3.0:1787393306.969771:0:16176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:3.0:1787393306.969778:0:16176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+5:2354:x1874217319659008:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787393306.969823:0:16176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f99b078-55e6-49ce-aa7b-246ff01aefa1+5:2354:x1874217319659008:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 46us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393306.969830:0:16176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:3.0:1787393306.969868:0:16176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:3.0:1787393306.969874:0:16176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c97c6862-5e64-402f-825d-1f36dc9c809c+5:2354:x1874217319659264:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393306.969994:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:2.0:1787393306.970003:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+5:2354:x1874217319658880:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787393306.970065:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319659136 00000100:00100000:1.0:1787393306.970069:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319659136 00000100:00100000:1.0:1787393306.970100:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:1.0:1787393306.970106:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c97c6862-5e64-402f-825d-1f36dc9c809c+6:2354:x1874217319659136:12345-192.168.203.21@tcp:400:kworker.0 00000100:00080000:0.0:1787393306.970304:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787393306.970309:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787393306.970312:0:14245:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787393306.970358:0:14887:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787393306.970367:0:14887:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1787393306.970386:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874217319658624 00000100:00100000:0.0:1787393306.970389:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874217319658624 00000100:00100000:0.0:1787393306.970415:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 121 00000100:00100000:0.0:1787393306.970446:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8181fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:2354:x1874217319658624:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393306.971779:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f99b078-55e6-49ce-aa7b-246ff01aefa1+5:2354:x1874217319658880:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 1768us (2371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393306.971792:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:2.0:1787393306.971829:0:14884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:2.0:1787393306.971865:0:14884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9de8089f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+5:2354:x1874217319659392:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787393306.971912:0:14884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c97c6862-5e64-402f-825d-1f36dc9c809c+5:2354:x1874217319659392:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 76us (2250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787393306.971918:0:14884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:1.0:1787393306.977654:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c97c6862-5e64-402f-825d-1f36dc9c809c+6:2354:x1874217319659136:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 7536us (8227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787393306.977741:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:3.0:1787393306.978597:0:16176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8089f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c97c6862-5e64-402f-825d-1f36dc9c809c+5:2354:x1874217319659264:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 8714us (9253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787393306.978611:0:16176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:0.0:1787393306.982756:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9de8181fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01bb6f60-100d-4ad2-b4cb-711641e2fe07+13:2354:x1874217319658624:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 12298us (13366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787393306.982771:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 121 00010000:00010000:2.0:1787393307.316500:0:14238:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29156 lines, 29156 kept, 0 dropped, 0 bad.